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^ \' ^X'ECUTIVE summary! • 

T^is report describes a .study of EOPS done by Educational Evaluation V 
Associates Ct^A). the purpose of the. study ]ivas to develop a plan for 
evaluating the EOPS program. * In developing thi^ ,plan EEA worked 
closely with two groups. •>One grdup represented community colleges 
^throughout the state. The other (ncfuded representatives of the 
legislatur:e and >/arious other agencies in 'Sacramento. ' 

In this "user-oriented approach," we based -the evaluatipn on the kinds 
oL-questions 'expressed, 'by these two user oroups. We compared these 
questions with the information tf^at' was 'Jilready being collected. In 
some cases the dat^ matched the questions. In other cases there was a 
mismatch. We determined how much useful information cpuld come from 
the existing sources and theVi constructed new'^measures to^'provide the 
missiri'g data. * . , ' » ' f 

The key features of thj^ report are : , » 

4 

. 1. We suggest some changes in several .of th^ existing data^sources: 
' ^ certain USRS ^data' elements, s.-hould be revised, anci a , new 

ahn.ual. USRS ^survey -of 'all, students should be conducted; 
an automated plan for analyzing the' final fiscal claim forms 
(Form A-1) shoufd be developecj;* ' ^ 
--.the -Operational Program Review (.OPR) shputd.be expanded in 
scope; , 

--the efforts of the California Post-Secondary- Education Com- 
mission (CPEC) to add an "EOPS Identification to., student data 
• * should be' supported. ' ^ ^ . 

We^ suggest several new measures: ' 

^ Supplementar Survey of EOPS student plans .and career goals ' 
shoufd be undertaken; ' / ^ 
" Longitudinal Study*' of EOPS students' *.^'t6ng-term sucofess , 

should be begyn;. ' . ' 

— a study of the differences between program plans "(Form 10) 
an'd program expenditures (Form A-1) .shp'uld' be done... This 
i will 'tell us which data can be used-^^to 'ans.wer certain 
^ questions, ^ ' ' , * 

3. We suggest an. evaluation report schedule*: ' * ' 

(It is not enough to si-mply gather information. ' Information must 
be communicated in a ciear^ and timely manner,) - . ! 
-- six evaluation re|Dorts for eafch' year's , program are 
recommended; * , \ 

' the focus of each report is described .along ' witN^ the da^ta 
required to complete each, v * \, 'i* 



\ 
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• Chapter I 
PROCEDURES 



' This report presents a recommended plan for state-wide evaluation 
of/ the_ EQPS ^program in the California Community College System. 
«The plan developed by Educational .Evaluation Associates (.EEA), has 
been' devised over a^ period of eight rhonths ,using a set of systematic 
procecfUres. The first step was the devefopment of a complete ^descrip- 
tion of data sources currently* available for evaluation of- EOPS. 
Concurrently^ we sought to ^understand of variouj^ .user con'^tituencies' 
^information needs. The primary mechanism for attaining this "user 
feedback'* was the establishment of two "evaluation study groups*'--one 
representing legisfative/executive users and one representing college 
user^s. . J ■ ' , 

In the next step, an analysis .of the matches ''between available 
information and - user . needs ' along with insights from other research 
studies .provided * the bases fon detailed recommendations. Iri these 
recommendations we maintained existing data sources wherever possible, 
made suggestions for modifications of some,, deleted othens, and sug- 
gested npw data sources to be added to the "fevaluation system. Equally 
as importarpt as the analysis the data sources are the recommenda- 
tions'for evaluation reporting and the analytic procedures for pro'ducing 
those reports.. The best evaluation data is of little worth unless it 
finds. way into a report or display that, helps users to improve 
programs or •make other important program decisions. 



Existing Data Sources 

As the initial step in the effort to devise a set of evaluation pro- 
cedures, for EOPS, we examined the existing data sources. -We focused 
. on six sources ^of information currently available: the .application fprm,- 
the fiscal and*, budget reporting . form, student data, th.? on-site, 
operational^ program ,revtew,'the fiscal audit, anB year-end reports. 
Information was gathered on each" of' these from tfjfee sources: 
examination of all . available matferials,' interviews' with "individuals who 
were developing or '.modifying existing procecf^ures >n'd comments and 
perceptions df EOPS groups about , the validity., of each source. 'We 
described each data source', indicated existing procedures for data 
storage and reporting and commented on. the' reliab lity and validity of 
th6 data. ,' ' / • ^' 

" - - ' 7 . 

• The Evakjation^ S tudy Groups ' ' / ' 

This effort wasj. guided:^ t>y . ^^e feedback two study gjioups 

representating the various user constituencies/ fhe project initially » 

' ' ' . ' ' / . 

conceived of a combjned study group represenffrig legislators, key* state 

decision makers at the executive* level, lQ<^al community college tjecision 

makers (including Deans and EOPS directors) and staff of the Special 

studies Unit of the Chancellor's, Office of the California Community 

Colleg'es. On further examination it seemed infeasible for the consultant 

to .meet simultaneously with all of these iadividuals. Thus, EE/^ along 

with the Director of Special' Studies (Ron Dyste) modified the procedure ' 

and formed two evaluation study groups, . . * . 

The legislative/executive study group included: James ^Browne 

(Aide tO/T Senator Alan Sieroty)> William Chavez (Assembly Consultant on 



Post-Secondary Education), Bruce Hamlett (Specialist, California Post- 
Secondary Education Commi ssion), Vinc ent Moritane (Aide to ^Senator 
Alf>ed Alquist),' George riormington (Principal Program Budget Analyst, 

• • - " 

Department of Finance), Dale Shimasaki (Legislative Analyst's Office) 

and Floyd WeintraUb (and subsequently''FiPank Barrrera) (Admissions and^" 

Oiitreach Services, University of California). A^ number of meetings 

were scheduled during the course of the project in order -to gain 

' insights into the informajion they required for decision making. Each 

of the members of the legislative/ executive study group attended at 

least one meeting; ' in addition brjefing papers, draft chapters and 

various summary tables were mailed to all group members for comment^. 

/ ' • ' . . 

The second group, "the colleges group'," consisted of th^ following 

Individuals: Norma Fimbres (Speciaf Programs, California State Univer- 

, Northridge), Ernest Gregoire '(EOPS Director, Mt, San Antonio 

College), Karia Henderson (EOPS Director, Los Angdies Pierce College), 

Christine Johnson (Dean .of Student Services, College of Alameda), 

f ^ * ; 

ivielirrda l.Matsuda (EOPS Director, Chabot College), Alfrecl Mendoza 
(Instructor, Vos Angeles Southwest College), Paul ^Preising (Instructor, 
Evergreen Valley College), and Buster Sano (Specialist, Chancellor's 
Office, CCC), The EEA team met with the "colleges . groupj' on a 
riumber of occasions during the contract period jn order to determine 
-the unique information needs at the local college level that might be met» 
a state-wide evaluation system* ^ 
In addition, members of. the two evaluation study groups not 
present at a meeting were contacted subsequently by EtA staff to 
obtain their inputs into the^ process. Typically, these contacts involved ^ 
mailing *the /materials that had been 'distributed at the meetings and . 



soliciting comments, but occasionally, phone interviews took place. Some 
rnember§ of the study group who were present at the* meetings were also 
contacted by phone to obtain further clarification of their comments. 



^ ^werat othrer individuals participated in each of the study groups 
in an ex-officio capacity. Ron^ Dyste, Director of, the Special Services 
Division of the Chancellor's Office participated on a. number of occasions 
and provided feedback on various reportsv George Ha)l, a mdmber of 
his staff, -was the contract monitor, made all arrangements, for meetings 
ancl also participated fully. Jennifer Franz, working on an allied pro- 
ject, also participated. In addition, the EEA ^.Consultant held meetings 
With the staff 'of. the Office of Special Studies^ Chancellor's Office, 
CCC* The purpose of these meetings was to obtain added insights into 

"^varibus evaluation data sources currently available. " ' 

As ^ pacl of the process of seeking the most broadly based con- 
sensus possible and being responsive to user needs, a presentatiori and 
discussion also took place at a state-wide meeting. of HOPS directors in 
Long Beach. ' * ' - 

Other Research Reports ' * ' , \ ' 

\n addit:ion to the study groups' input, we^ examined several 
prominent research refits that might provide appropriate insights for 
devising a state-wide EOPS evaluation system. While there were man.y 

r;elated reports that might have been examined, four seemed particularly 

/. ' ' . I ' ' 

relevant. They were: The Stat^wid6 , Longitudinal Study of Community 

College Students -(Sh^Won and .Huntpr); What Happened to the E^DPS 

Students .of Fall' 1973? (Preising); College Going Rates, in California 

(knpell); and The Study of Extended Opportunity Programs and 



Services in California Community Colleges. (Farland, Rose, Ny6r & 
Ti:ent; Evaluation 6nd Ti^ainihg Institute^) in each instance we n^tained 
a copy, of the research report(s) and renewed it thoroughly. Some 
reports, wdre' single volumes (such as ETI); in other instances the wiork 
of tbe project constituted a number of separate but^m^er studies 
(such as The State-Wide Longitudinal Study). Occasionally, we bene- 
fited from a phone Interview with the author of the^report (e.g. Steve 
Sheldon) or a -ipore * casual conversVtion (e.g. Payl Preising); .and, in 
one instance a co-author was commissioned to write a paper specifically 
directed to the issue of development of the state-wide BOPS evaluation 
based on his report (James Trent - ETI report). With respect to the 
State-Wide^\ongitudinal Study, we benefited from the recently completed 
analysis of that study by Jennifer. Franz (1981),- In summary, an 
analysis 'of these various studies provided, an additional element for 
consideration in^devfsing' the recommended EOPS evaluation /system, ^ 

Devising a >P1an . , ' , 

The remainder of t^^ repbrt is quite straightforward. .Th^re is a 
certain logical consistancy from chapter to chapter/ ^h\ch follows the 
reasoning process exemplified, by' the following set of questions: ^ 
(t) W^qat'ar^ th^ existing sources of data and ^ar^e. they usable in their 
present form?, ' • ' \ ^ 

(2) What are the information needs *ot the v^riou^ user audiences? 

(3) To what extent do useable data sources meet the existing 
inforrrtation*needs? ' , ' . . . ^ ^ 

(4) What insights can* be gaine<;J ^bout state-wide evaluation of, EOPS 
from othef research studies? 

« 

. iO • 



(5) Should each\existihg data* source be retained, modified^ or .deleted? 

* - . • * ^* ^ 

(6) What additional data sources are appropiate for meeting specified 

• . • , / 

and unmet user information ne^ds? 
C7) -WhaLJs^the^timetahle-foii^ata^cpil^ — ^ ^ - ~ - = ■ 

(8) AVhat 'evaluation reports should, be produced to serv^the various 

^ information needs? What^ data sources are 'to be a part of eacfj 

'* * . " » 

report? . ' 

(9) ^ \Vhat is the reporting time schedule? 

(10) What analysis procedures are required for producing the specified 

k 

* evaluation reports? , ' , 



^ * / • Chapter II - , 
. . EX ISTING EVAL UATION Sy<^TPMS 

Our work on ti\\s project includes,- as one of its components, a 
^ ■ . ,. : 

review'-of exjstmg evaluatfon Systems used for state-wide assessment of 

community college EOPS Programs. *• WhMe *no concerted effor.t has yet 

\ f -i ' " 

been, made to develop a state-wide' evaluation system, -there are nonethe- 
less, , elements present that might be thought of as an "existing evafu- 
•ation system^.". Data are collected from many sources. ' Supplemental 
analysis of this data is conducted ^^s wejy as other project activities' 

which have evaluation implications. Finally, . there are personnel 

^ ♦ * • r 

throughout the system^ who, in sopie. wa^, engage in evaluation. 

' - / ' - ' • 

Perhaps it is an exaggeration to call this aggre^atfk "of data sources, 

procedures .and people »a*» "system,-" but their presence must be under- 

stood, accounted for, and improved in the su|^sequen^development-of a 

well integrated state-wide- evaluation plan. We will consider eactTbf 

these areas separately/ * ^ - . ^ ^« 

• ' Data' Sources . * 



A discussion of the current EOPS^|>rogram monitoring, -&nd evalu- 
ation procedures of .the' Chahcellor*s Office of the Calffornia Corrlmunity 

2 ^ • . • • ' 'J 

Colleges, reveals six sources of^ evaluatiqh dafa about the program-. 

These ^ix ^sources are: - " ** , • ' . ^ 

, 1. » The^ application form (EOPS .Foi:m>#10)/ * - / ' 
2» Fiscal and budget reporting (Form A-1) ^ 
3» Student data (Student Da1:a Cards and '"USRS") . \ 

4. On-5ite operational program j^eview (proposed) 



5. Fiscal aud\\ " "S, ' 

6, Year-end reports (EOPS Form #12)* « ^ 

, In the folfowing Six sections we will describe each data source, indicate 
where and in what fprm the information is stored, and ^assess its, 
reHabillty and. vatidiiys ^ ' * * 

Application Form ' ^ 

EOPS Form #10:^ Description , An ^ application for EOPS. funding* 
must be submitted annually to' the '.Chancellor's Office by eech commun- 
ity college. This application (EOPS Form #10), describes the propos ed' 
program including the iiscal resources required for its operation. The 
form includes -a listing- crf personnel to be assigned to the -project, of 
services to be provided to students, of materials to be purchased', of 
student population' to be served, etcJ In short, a r;ich data base is. 
available describing the intentions of the EOPS programs throughout the 
state. " c . ' * 

The program description begins with a staterfient of project goals 
ahd an abstract of community-based' needs. It includes a staterfient of 
need, a de:?briptiori of planned activities, arid a list qf outp'ut objectives 
reported for each component. The application form ' requires that^ the 
projected organizational structure be broken down into' nine programing- 
related •categories; including, foV example. Management Services (100), 
Outreach Services ,(200), Instructional Development and Services <300), 
Dirijept Aid to Students (900), etc. This inWmation fills about half. of 
the pages in the application. ' « 

The i;est of the application is -concerned with reporting -budget 
data in considerable de^tail. Each* of the nine components is broken 



down into between' three and five activity type"sr^rTd^^-ppo|eeted staff 
salaries are budgeted by activity type. Thus, for example, the 
Instructional Development and Services Component (300) is .subdivided 
into four activity are^^s; ' * ^ ^ , 

Curriculum and Course Development 031O) 

Instructional Services <320) ' ♦ 
Tutoring (330) , ' 

Other (34b) . , . ^ ^ ^ . ' , ^ 

Personnel ^costs for each empJoyee,are reported by component, and, in 
addition, the percentage of time each individual will spend on eaqk 
activity is indicated, (For a complete listing of all 37 activity types, 
see Appendix A), . • . 7 ^ ' - 

Non-personnel costs are also reported, by component. Standard 
four digit accounting codes are used in reporting these costs (materials, 
supplies, equipment, etc) Both those items funded from EOPS money 
and those paid fpr by the district's own fands tnust be included in the 
application, ^ . ^ , ' 

Also reported, .are the number of" student contacts anticipated for 
each component, and the total estimated undupllcated number of 
students served, ' ' 

As this brief overview clearly indicates, the EOPS program appli-, 
cation is an extremely detailed document, rontaiffing a wealth of 
Information about the anticipated proghSm, One caution is in order, 
however: it Is only a proposa l. As such, it may or may not represent 
an accurate description of actual program activities -and expenditures , , 
It will be important to .determine the differences between these proposed 
budgets Reported on. Form #10, and actual program expenditure levels,'^ 

14 
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An^ estimate^of these differences' may. be .available from other fiscal 

.reports and this will be investigated m a subsequent section : 

EQPS' Form'#10: Data Storage'$nd^ Reporting / The /Canceller's 

Office 6f,the California Community ""Col leges contracted with Survey Data 

Associates of Los Angeles to develop* software for computer coding and 

analysis of the data .from EOlfS Form #10/ The software that was 

developed can analyze all the quantitative data in the program appli- 

cations (e.g. , budget, activity types, numbers of students, etc.), but 

the 'program descriptions^ (need,^ goals, activities, etc.) are not being 

coded or analyzed. Thus a great deal of' the information contained in 

♦ 

the , application forms vyill hot be accessible from the computer files and 

no reports or analysis, are planned. 

* .However, ^an^ly^ing ; only "the numerical data is still a substantial 
I ^ if , ^ ' 

task, and there is mUch information to be found there. Survey Data^ 

' /dissociates has also been asked to conduct some data anaJysis of the 

/|980-81 program applications, and they ,have already produced summary 

\ tab^ulations of the first 3 data categories. In 'each instance, the 

inalyze'd data have been reported by individual college aofi then 

aggregated J;)y district, geographic region, size of school, school type 

(urban/suburban/ rural) and,' finally, a statewide summary. The 

completed reports describe: 

- • ' * / 

'*.a. Program Activity Types (Item 1.9 oY EOPS Form #10). This 

^ 

report tabulates which of the 39. activity types is included in each, 
:>chooL's program application. The' amount of activity 'is not reported, 
,but only its presence or absence as a part of the schobMs program. 

b. Other Funding Sources- ( Item 2,8 of EOPS Form #10). This^ 
ijeport spmrtiariies the amount of money available to each college from all . 

IS ' ' ■ 
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other sources which have potential or actual use in serving disadvan- 
taged students. The report also indicates, in each, case, ^whether the 
use of these funds is coordihated^ with the HOPS program. 

c. Direct Student Aid (Component 900 of HOPS Form #10). This 
report describes /all grants, scholarships and work study funds paid to 
students (both HOPS students and regular students) from all funding 
sources.. This includes federal, stajte, institutional and private monies. 

The final report" to be prepared this Spring and submitted by the 

%. ' ^ 

end of the contract year (Jqly, 1981), is the most complex. It will 

ti ' ' • ' • ^ . ' ' 

describe the complete breakdown of aU personnel costs jDy component 
and by activity type (Item 3.5 of Form #10) .\ 

At the conclusion pf the analysis, SDA will give the raw data tapes 
and all reports to the Chancel lor*s Office where they will be available 
for further analysis, if desired. The Chancellor's Office can then 

r 

conduct similar analyses of Form #10' data in the future. 
■ ' Some small refinements in the ^system for next year are still being 

considered. In particular. Survey Data Associates has suggested ^iome 
changes in Form #10 to' simplify, future data coding. Final decisions on 
these changes should be reached by' the Summer of 1981. 

EOPS Form #10: Reliability and Validity . The data /themselves 
"appear to be quite accurate. The chief analyst at Survey Data Asso- 
ciates estimates an error rate of less than 2%. This should not be too 
surprising, since there are built-in cross checks against arithmetic and 
clerical errors in most budget reports. 

There was one small exception to this' -high accuracy estimat^. 
Apparently, directions^ were unclear and confusion developed about 
the procedures for calculating the unduplicated student total on the 

k ■ '-' 16 



summary page^ The numerous i^rrors in this item appear to be.thfe 

fault of overly complex instructiorfs. The problem is not too\serious, 

\ ' J ' i ^ * ' ^ 

however, because the correct calculatioh can ,be performed using the 

data reported on the individual componeni pafges. / ' * " 

The cteta also appear to fairly represent the entireLsystem/ There 

are 106 coTpmunity< colleg.es in the system, and Survey Data Associates 

had initially been provided with applications from' 83 of these schobis 

for its an'alysis. The reason for the missing data was not clear. For 

* * . ' • 

some reason, data for only 78% of the colleges^'were initially forwarded 

to SDA,. However, that problem* has now' been remedied and the full 
ata set fs available for analysis. 

Overall, our analysis shows that accurate and representative 'data 

- ■ • * -1 . » . ■ . 

on proposed ,EOPS jirogram^ budgets and activities do exist. The 
Chanceflor's Office has the cafiability to continue generating similar 
information in future yearS. It should be reiterated, however, that 
these are only the projected (Quantitative data frbm HOPS' Form iflO. 
Program data on project obj|ectiv^s>/ needs anticipated outcomes are 
^ not available on the' computer,' or »in 'any other aggregated^ "^orm. 

Fiscal Reporting Procedures « . , 

* The total funding • level on which th6 EOPS program application^ 

are based, does not necessarily, equal. tjie total* allocation the school wilt 

" / « ' ' ^ * 

eventually receive for jts EOPS project. As a result, the prdjected 

budgets will probably differ from the actual expenditures during ttie 

year. Therefore, it becomes important to investigate the procedures 

that are employed to^ monitor and report on acutal^ program expensi^. 

We found, that actual expenditures are reported at the same level 

of detail as in the , projected budgets in terms of standard accounting 



ERIC 



. * 13 

codes; however, . th,e expenditure reports show sortiewhat less detail in 
program categories than the budgets. This will be. described more full.y 
in the following sections. 

Final Proje ct Allotations . Final project albcations are npt deter- 
. nuned until June or July, after the ,new state budget is signed into law. 
A mathematical formula determines what share of the total statewide 
^ allocation is given to- each, college. The formula assigns wel^ts to 
different elements of the EOPS program proposal— number of Students 
served, demonstrated need, etc.— and calculates each college's portion 
. of the total" allocation based on a weighted sum of elemegts of their 
, proposal.. 

Before colleges can begrn their EOPS program activities, they must 
first obtain approval for a revised budget which reflects the actuaJ 
allocation level, rather than the level of funding they projected in their 
initial application. Revisions are begun in the spring^^ter tentative 
^ figures have been provided, but final determination awaits the signing 
of the official state budget. , , . 

Fiscal Reporting Requirements . when schools receive the formal 
notification of their finalKproject allocations for the year, they must 
stibmit a revised bcidget arid a request for budget approval using the 
EOPS -Budget and Accounting Form (EOPS * Form A-1)t This form 
requires .that expenditures be broken, down^ by object code, using the 
same standard four digit^^ codes that were used in the program appli- 
cation. In addition,, each expenditure must be coded according to the 
major^ program category which it supports. For fiscal reporting pur- 
poses, 'the school's progVam has three major program categories rather 
.than the 39 program subcomponents used on the program application: 

- , ' 18 ■ ' ■ 
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o Category A -.Program Development and Maintenance; 

0 Category B - Student Services; 

0 Category C - Direct Payment to Students. 
•In addition to the proposed expenditure levels, colleges report the 
district's fin^ial contribution , to E0t>3-related services and the esti- 
m^ed number of students 'served by program activitfes in categories B 
and C- Once this' form has been prepared, At is submitted to the 
ChahcellOr's Office for approval. * ^ 
During the coprse of the year;, a variety of fiscal procedures are 
in force. Mid-year invoices: , . claims and transfers are. each reported on 
a separate HOPS form. Invoices and Claims (HOPS Forms A-2 and A-3) 
must be submitted before any funds can iSe transterred^to the college's 
account. Such requests*' ar^ us^jally filed quarterly, but can be sub- 
mitted as often as desired. These forms have only limited interest .fVom 
the ppint of view of program evaluation.^ ; ^^^^\ 

Gf potentially greater interest for evaluation are the EOPS 
^Transfer Requests (EOPS Form A-4). Colleges must obtain approval for 
any* transfers of funds between major program categories. A brief 
explanation Pf the reason for the transfer must* accompany any such 
request. Beqaruse such transfjers reflect potentially important changed 
in the schooPs program, the accompanying docuhentation may be useful 
in program 'monitoring and review. • \, - 

In practice, very few majdr transfers of the type desc ove 
are actually rpade. Mor.e often / colleges" ma kp minor adjustmer>ts withjn. 
program categories. ^ These minor changes do not need advance 
app.royal. However, as a matter of course, most colleges do notify the 
Chancellor's Office of such changes. ' ^ ' . 



^ A% the end of^the year, a final claim must be submitted by filling 
.out in its entiVety the same form (EOPS Form A-1) that was -used for 
the budget approval. All expenditures must be reported by object code' 
•and by^ major program category. In addition, all transfers (both 
between categories and within categories) must be shown. The dist- 
rict's financial contribution must be desci^ib^d, and the total numioer of 
unduplicated students served in Categories B and C must b8 reported. 
These reports are sent to th^ Chancellor's Office whfere th^y are 
reviewed- fai> accuracy and 'errqrs'^are corrected. * * 

Data Availability and ^Reportincj . All fiscal reports we bave de- ^ 
scnbed ar^e filed with the Specijiiy Funde'd Program ^unit in Sacramento, 
where they are maintained thoroughout the year. At the present time, 
all auditing and review is based on the actual documents that are sub- 
mitted. Nothing is coded for computer analysis oc stored on magnetic- 
tape. ' ' . ' ^ 

<3enerally speaking, few » summary -reports are compiled. One end 
of the year compilation is made of the overall state-wjde aggregation, of 
expenditures by object code and major progr am catego ry. Unless there 
are .special requests foK oth^r information, no further analysis or 
aggregation is usually carried out. : 

' Reliability and Validity . ' The fiscal reporting system, is quite 
accurate. Expenditures are closely monitored throughout the year to 
insure that colleges do* not exceed their allpcated funding level. End- 
of-thfe-ytear reports^^must balance, qf^ course, and. they ^are carefully 
checked and revised if there are any errors. Thus, the 'fiscal data 
that is available is completely/ accurate. 
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The only non-dollar figures reported" on the fiscil forms are the 
nurnbei? of students served. While it is^ acknowledged* that this figure 
may not .be as accurate as the expenditure figures*, it nonetheless^ 
merits attention as one, measure of program impact and level of service 

' Student Data • / 

The community college system has had a mechartls(n for collecting 
data gn student demography, and academic progress for a number of 
years. For, the* past five or six years, supplemental data on EOPS 
students have been collected using the EOPS Student Data Cards. The 
system is n^w changing, ' and the collection of data on EOPS students' 
soon, will be .fnteg rated into the Uniform Statewide Reporting Systelm 
(USRS). This system is being pilot tested in the Spring of 198.1, and 
will be fully implemented in the Fall of '198.1, when the data from the 
academic year, 1980-81 ■ are to be' reported- by tthe colleges. We willr 
describe both the existing Student Data Card system a^d the new 
USERS approach. \ ' 

, ' EOPS Student Data Qards--Des'cription .' Each coflege has.- been 
required by the Chancellor's Office io submit basic and, ^upplgthental 
^data ort each EOPS student. Three forms were used: *^one jarovided 
certain school-wide summary data ancj the other, tWo reported on char- 
acteristrcs *of each EOPS' studfent. The collegia was responsible for 
coding the d;ata and subfmitting it on punched c^rds or hfiagnetit tape to. 
the Chancellors* Office (some 'smaller colfeges still provide documentary 
mput) 

. - Form^ #1 requested varPous demographic data ^about each EOPS 
student including sex, age, ethnic background, highe^ grade attended 
apfd marital status. Also included were a number-of items^ related to. 




•students' financial status and eligibility fqrnhe program. A number of 

A -■ . ' 

Items on Form 1 were optional: the directions indicated that these items- 

1* ■ ■ -■ . 

"may be . included or excluded as you desire. "these optional items will 

not be >processed by the Chancellor's Office *at this^ time." "As one 
might expect, very few of these items weW completed'' for most stu- 
dents. Ofitrohal items ' included qqestions which might be considered 
confidential (e.g. student's . name, address, 'living arrangements, 
Income, family status, initial contact wit'b the school and, initial contact 
with EOPS). , ' . * ■ ■ . ' ' 

EOPS Form 2 - Student Data was designed^ to' pVovide data aboOt- 
-financial grants to students^ EOPS" services prov,ide^, and the student'? 
academic progress and accomplishments ;« The form requested data on 
^the financial need of each student ^(ef.g.;, doljar .amount of EOPSl grant, 
scholarship ampunt). In addition,;* d^ta " were fo *be ^provided on the 
services • received (e.g., hours of recruitment tHne, hours of tutorial 
time, hours of couns^liiSg). " In the a rea^Jf academic progress, each 
college was asked to repopt the "students*^ college m^jor,' the number of 
units ^ attempted, the number completey„« and the students' cumulative 
.GPA at \h^ end eacfi term. Fin-ally, .the. fdV^m required some rrTeasure 
of Students* "accomplishments" (e,g* , ^ whether^h^y • received an AA ■ 
certificate pursued^ a four yegr^degred or ^oup?' employment). 

' jyith the exception 6f the student's narlie, all. of the information on 

Form 2f^vjas required- (Students had the'^p^ion of providing an LD. 

A . • / . ' . ' 

number other than their Social Securit>s^umb^, so long as they us^d 

the same I.D. number on a[\ forms. r)^ > ^ 

. The flnaf form (Form^S) provided a su^iparf of institutional data, 

This form was- designed to obtain statistic^ on' college-wide indicators, 

• ■ ' ■. -.22. ■ 



such as the withdrawal rate and the overall GPA at the college -These 
indicators might be used for comparisons bfetween colleges. In adc^it-ion, 
Form. #3 provided data about the amount of'^EOPS funds expended in 
seven specific program categories. ^ •■ 

EOPS "student Data Cards Data Storage and Reporting . , Each 
college was redjuired to submit the EOPS'sfudent bata Card information 
to the; Chanc^llorfs Off ice >y the end of October. These\record^ were 
compiled on magnetic tapes and stored at the Teal Data Center in 



Sacramento.^ 



Limited^ uses were m-ade of data from HOPS Student; Datacards. A 
single pBge ^Jmmary containing descriptjve statistics was usualJy pre-, 
pared for ^each school. The/*most important" items from the forms vvere 
reported, including units attempted and units' completed. A stat'e-wide 
summary was also prepared, and it , proved useful as^a data base for 
describing the EOPS program* in legislative bud^ -h^rings. The 
report* provided e^vidence about the special nfeeds of EOPS students and 
the^level of participation in the program. Apart from these two docu-^ 

, r 
« ^ ^ > 

"rpents, little was done with the data once^ft had been collected. 

( ' ( ^ \ 

Y N[here are a number of reasons for the,»see|iing underutilizatioh >6f 

the data. The data collection systerruvvas established -with good inten- 

tions, .under^the assumption that the information would •be us'eful. 

However,, data analyses do not appear to be directed by the need for 

answers to specific predetermined questions* In EEA's experience, data 

collected to be part of an "information base" rather than supplying 

specific information needs are seldom useful. Furthermore^ storing of 

^the student data ^tapes m Sacramento at the Chancellor's Office aod 

thfe computer tapes for the 'program application (Form #10) at another 
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• location increases the difficulty of merging these two sources 'of dats ' 
-» 

There are apparently plans to remedy this problem. 

EOPSrStudent Data Fo rms--Reliabilit^nd Validity . . These data ; 

appear to be somewhat less representative and less accur,ate than the 

program appjication data (Form #lO) described above. The percentage 

of EOPS students on whom data i^s .actually reported has ranged from a 

low oft35% of 'the tot^l EOPS population to a high of 86% over the past 

five years. .The overall trend has been 'toward more complete report- 

Jng; two -years'^ ago v'dat^ Were received on approximately 52,000 EOPS 

students out of total of ■SOro'oO. ' No- attempt~'has-been made to determine 

——"^ 1 • ^ 
whether'the characteristics of the students, who did not report ^ differed ' 

in a/y significant manner from those who did. ^' / 

In additlorf to our concern about, the percentage of forms received;' 

we must also address "^he question of the accuracy of the data that are. 

reported. Depending on the. particular item ih qoestion, this accuracy 

varies considerably, data ran^e from "totally unusable Id quite accu- 

rate" as one person at the Analytic Studies unit suggested. ' . * , 

For example, data on student enrollment--number *bf units 

attempted^ number of units completed, grade point average--are prob- 

ably accurate. Such information i$ central to the functioning of the 

college: it plays a key role in fiscal decision, and is highly relevant to . 

academic admfiiistration. As a result, it is recorded with greater care 

and maintained up-to-date throughout the year. * 

On* the other hand, many^of Jme items reported on the Student 

Data 'Cards are not the subject of such careful ^att^ntion. For example, 

reports of EOPS contacts— the recruitment, tutoring, counseling and ' 

other EOPS service hours received by each 3tudent--are p^robably not 
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accuVate. .In fact, only two ^of these items have been retained in the 

•new USRS System., Jt was felt that only specific tutoring 'and counsel- 

ing hours could be compiled rdas^ohabl'y and accurately over the couf^se 

a -year. . ^ . ' - . . 

The feeling among people who have worked with the Student D^ta 

Cards over the years, is tt^t many Of the data items are almost 

worthless.! ' In .a-^discussion of the directions that should be taken in 

developing a new evaluation system, one. member of the evaluation study 

group reflected back on the Student Data Cards:' 

"Data cards? The data have not been usBd because they knew it 
was not good date. Whatever is put. together in an » evaluation 
system must go forward and not look back, becatj^e the previous 
data are not good.'* ^ ' ^ ^ « 

Several factors account for the inaccuracy of much information. 

Different problems arose with djfffe'rent informatfon categories. We will 

mention four problems, noting ^thaf various of these issues^ were 

relevant to different data items. ^ 

1) Students failed to report some items: Their own income level, 
for example, was frequentlv^ not reported. L- 

2) Students lacked knowledge ofis. sorrv^ items, such, as' their 
parents' income levek ^ ' • ' . , 

3) The^e were ^f laws in the -data' reporting sys^^em. ^ For example, 
ther'B were only four di.gits allowed for zip code, but it was 
not cle&r whether the first four digits or th^ last four digjts 
were to be reporte^tf. 

4) ' The data reporting forms were hot self-contained, /and it was 

sometimes necessary to refer to a second document^tp obtain 
an explanation of . an item. This was not always done. * ^ 

' . * i 

In summary, the EOPS Student Data Cards were de'sfgned to collect 
a great deal of relevant information* on EOPS students. Over time, the 
number of students on whom data are collected has grown ^considerably. 
A reasonably high return 'rate has been achieved in the lastttwo years. 
Hoyyever, the accuracy of the reported data varies considerably frcyn 
element to eleWent. ^ * , . 



The information has not been used extensively, as far as we coqid 
•determine. As one college member^ of the^ evaluatibn study group com- 
Rented; 'H^hose of us in the field have never understood the 'use of- 
'student 'Data Cards, ,or ^hy we . need to go' throu^ this exercise in 
futility every year." * , ^ ' 

starting withy-the O.ctober 1981 reporting cycle, a " new system yyi+U 
beTj&^'for collecting this mformation aQ(Kit is to that "system that^we 
now tulVi our j;attention . . ' > ' ■ \ 

Ug'RS— Desc'riXtion. As of October 1981, aU cdmmumty colleges 
will bdgin reporting\£OPs' student dat;a as part 'of. the iMrform Statevl^ide 
Report/ng System (USRS),.k(Td the" useof the EOPSStudent Data C^rds 
.be discontu^ed. USRS is a comprehensive reporting system 
developed to standardize and simplify information gathering throughout 
the community cdllege systemtC' It was pilot.tested in Spring, 1981, "and 
will be fullyjmplemented by Fall, 1981.' ' " ' • ^"^ 
\ The^USRS. system wiJJ .gather ^data on a variety of different topics, 

principally, characteristics of tl^e total student population and' measures' 

'\ ' ■ / ■ 

of instructional- 'activi^ iD addition, special sections deal wij:h other 

topics '.such an enrollment in non-credit courses, the EOPS program, 

handicapped* Students and the vocational education program. 

Information pfriht^rest to avaluators of^ the EOPS prog raq^ wilt be 

found in twp plaqes. Background data onS^ students will be found* 

among the common student eFements reported eajh^quarter for everyone 

enrolled in the- system;. supp1ementaf*i^^omatibn relating specifically tfi 

' ^ ' ^ % 

the EOPS students will be found among the special EOPS'studerit data* 

Elements collected annually. • ^ 



Most of the information from Form #1 of the old Student Data 
Cards will be found among the common student* elements. This^ broad 
category includes information about citizenship, high school education, 
residence, personal characteristics (age, sex, race) and student aca- 
demic progress. Of particular interest will be units of regular credit 
courses attempted and^positive attendance course enrollment ^-enrollme^ft 
in shortrterm or non-credit courses for which daily attendance records 
are maintained). Toljal jwgekly classroom hours is another data element 
which is being collected. This, item takes on importance, because not 
all courses offering the same number of credits meet for the same 
number of hours each week. Vocational education courses, for example, . 
usually require a much greater number of classroom hours for each unit 
of credit earned. 

Much of the information that was dgntained in Form #2 of. the 
Student Data Cards has been incorporated into the special HOPS dpta 
elerpents. This includes the student's academic number of units com- 
pleted, financial aid awarded, CPA for the term/ cumulative CPA, and 
the number of hours of EOPS counseling and tutoring services received. 

Some of the Items from Form #2 have been dropped. Colleges are 
no longer required to report "accomplishments" (^^e., certificate, 
degree, job placement), infprmation which was podrly reported in the 
past. i(ln many respects, the loss of this potentially Important outcome 
data is 'quite unfortunate.) The section on EOPS services received has 
been simplified, requiring only tutoring and counseling hours to be 
reported, and omitting recruitment, re-recruitment and other service 
hours* ' Academic major js reported as it was in the past, >though 
each s'dhool uses its own codes to identify major fields. It would-be 
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possible, though somewhat more difficult, to decode and aggregate this 
piece of information. 

Overall, there are only minor differences between the data that 
was available on HOPS students under tHe ohd system and that which 
will be available under USRS. 

. :.^jJSRS--Data Stor age and Reporting . As was ,the case with data 
from the previous student data cards, all USRS data will be compiled by 
the individual colleges and transmitted on cards or magnetic tape to the 
Chancellor's Office. Systemwide data tape;? will continue to be main- 
tained at the Teale Data Center. 

It has not yet been determii;)ed what analyses will be done or what 



reports will be written. Certainly 



some reporting back to the schools 



and some statewide aggregation * will continue as jn the past. Beyond 
that; )|owever, there have been no decisions about what information will 



'be .tab)j|ated and in what form it will be presented. As in the past, 
this will be determined by the information need? of the various offices 
and agencies and by the_pViorities that are established between no*w and 
the. time Jthe analysis begins, 

USRS— Reliabitity and Validity . Careful consultation has gone into 
the development of USRS, and every attempt has been made to insure -^ 
that the^ resulting data are accurate and representative. At this point, 
discussion of the reliability and validity of data not yet collected can be 
only conjecture. However, the plans for data handling suggest, that 
reliabili^T^nd validity will both be improved. 

For ^example, the first step will be to conduct preliminary valida- 
tion checks pf the reported data. Internal checks. of the coding itself 
will detect errors. Summary statistics and reports of erroneous data 

* e ' 
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will then be returned to each college for further verification and cor- 
rection before the- data are finally analyzed. 

It is anticipated that more attention 'will be paid to some items in 
the. validation process than others. For example, there will probablv be 
no attempt to validate how accurately students' academic go^^\w are 
reported.. On the other hand, sample census data on actual coursed 
enrollments will be returned to each college for careful cross checking! 
Similarly, there may or may not be any attempt to valfdate the accuracy 
of the counseling and tutpr'ing hours reported for HOPS students. In 
this respect, the attitude seems sirmlar to the one taken toward the old 
EOPS Student Data Cards; some information will probably be .deemed 
less important than the rest (based on a variety of criteria; e,g., 
perceived jow validity, low priority, cost). 

The overall impression is that the USRS system Will be more reli- 
abje than the previous data collection effort. There are other reasons 
for this observation in addition to the careful organization that has 
gone into developing the system- For one thing., the data reporting 
will now be coordinated by the data prpcessing ^offices at the colleges 
/rather than by the EOPS directors. The individuals working in the 
data processing departments are more attuned to the data collection" 
concerns than those individuals who most often had the responsibility 
for the Student Datcr-G^rds, .(On the other hand, they are further, 
from the EOPS pi'ogram and may not have some data availably) 
Secondly, some of the more ambiguous or unclear items werfe deleted 
from the reporting formats, A third reason for thinking that the data 

reported in USF^S will be more accurate is that some of the. EOPS 

* * * • 

^program functions (e.g, tijtoring and counseling) have begun to receive 

29 . 
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increased funding from , the federal government and this funding carrfes 
with it requirements for more detailed and complete record keeping. 
These improved record keeping systems should increase the reliability 
of the data reported to! USRS. 

It is too early to tell .how complete the reporting will be- under 
USRS. The reason for developing a unified system was to standardize 
ref^rting requirements and thus make the process easier. More com- 
plete and accurate results are anticipated, but'we have no basis for 
judging whether the percentage of student data reported under USRS 
will increase or decline, or whether the data that are reported will be 
more or less accurate than before. 

Operational Prog/^am Review Process - 
4. 

Beginning ?n the fall of 1981, the Specially Funded program unit of 
the Chancellor's Office hopes to implement an on-site monitoring and. 
review program called the Operational Program Review process. 
Planning for this effort has been underway for some time?, but the final 
decisions op the size and scope of the pJrogram will not be made for 
another two or three months. The following reports the current 
planning for these activities* 

During Phase I of the planning for this activity, the initial moni- 
.toring and review model developed by the Specially Funded Prograhfi 
unit was reviewed by field personnel from three special programs-- 
EOPS, handjcappeb and financial aid. These three task forces critiqued 
the initial model, made^ recommendations for modifications and suggested 
procedures for implementation. / 

During Phase II, which is currently underway, the in-house staff 
of the Chancellor's Office is reviewing the recommendations from the 



tBsk" forces and preparing a. revised program model and implementation 
Strategy. In Phase III; the final model will be submitted to the Execu- 
tWe staff of the Chancel lor*s Office for approval and submission to the. 



Board of Governors. 

Description , We wilt present a briefdescription of the Operational 



knowledge that it may yet undergo modifications. What follows should 

be understood as a tentative picture which provides only a general 

t 

' outline of the OPR process. 

As currently envisioned, the OPR process will be a two or three- 

^ day on-site team review of colleges' Specially Funded programs--EOPS, 
handicapped and financial aid. * Jime and resource constraints will 
probably limit the number of colleges that may be visited each year. 
One staff- person in the Specially Funded Program Unit, "guestimated" 
that between 20% and 30% of the community colleges mig^=^t be reviewed 
annually. Thus, all colleges woulS be visited withih a 4-year cycle. 
At the present time, the "Xhancellor's Office staff hopes to begin the 
OPR process in 1581-82 with a sarrt^le of up to 20 community colleges. 

The purpose of the OPR process is to assist colleges . in preparing 
for state, and federal program audits, reviews, evaluations and/or 
accredidations. Within this general framework, two sets of documents 
have been prepared to foc<j||^the review efforts. They are referred to 
as the Compliance Documents and the Parameters Documents. 

The "Compliance Documents" contain a complete listing of all state 
ajcid federal requirements for record keeping for each of the three pro- 
grams. * Using these as guidelines, the team members wiH review with 
the college's pro|ram staff all *the documentation they should have to 
comply" with existing regulations; , • • ^ 



Program Review process 




with the full 
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The "Parameters Dbcgments" for each specially . funded program, 
contain a comprehensive list of all activities that one might envision in 
an Ideal program. Comparing these, to actual programs, the team mem- 
bers would be able to identify where the college is making exceptional 
effort and wh^re additional attention might prove worthwhile. 

The previous two paragraphs might suggest thai" the OPR' process 
will focus on examination of documents and ignore the obslrvation of 
actuar program activities.,. This" is. not the case. < The OPR process is 
designed to be much more »than merely a "paper chase." Both, irt the 
area of cdmpliance' and in -the area of program activities, the team 
members will observe project activities, discuss issues of concern with 
relevant staff and participants, and check to see the extent to which 
actual program activities matched what had been specified on paper. 

At the conclusion of the OPR process the team will conduct an exit 
interview with the staff at the ^college and prepare a written report to 
the college and the Chancellor's Qffice 'soon thereafter. 

Operational Program Review in Evaluation -System . It is/ of course, 
too*early to tell exactly, how usefyl the written documentation from the 
OPR might be in a broajd-based' HOPS evaluation system. As envisioned, 
the OPR process will consider bottOhatters of compliance and program 
effectiveness. T^us, it might well offer valuable data on program 
implementation, typ*e of services offered and effectiveness of program 
'activities* The parameters document in particular, may provide a 
useful hieasure of program - implementation . Our experience with such 
"checklists" in other C9ntexts cautions us that its use may evolve into a 
simple cross checking form which identifies neither level nor quality of 
services rendered in. each category. Barring thi?, it has great*poten- 
tial^ as an element in a larger evaluation system. 

. .32 •,. 
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Fiscal Audit Procedures ^ 

The authority for auditing HOPS programs stems . from a 1951 
' statute stating that "Audits were^to be performed to determine the 
validity of the' ajlocation of state funds f6r school/program purposes and 
to establish proper fiscal accountability" (Chapter 1259). The legis- 
lature has reconfirmed the intent of this statue with the enactment of 
Senate Bill 787. . 

In the spirit of Bill 787, the 'Department of Finance and the 
ChanceJtpr's Staff jointly carried out approximately 12 audits of' HOPS 
programs 'in 1979-80. Since that time, the procedure has been tempo- 
rarily .discontinued in favor of a new model--an BOPS self-audit, which 
is only in its pilot phase at ,the present time.. The new sglf audit will 
be described below,' but first we will review the, strengths and weak- 
nesses of the existing audit ^process. This will also familiarize the 
reader with^he important content areas to be addressed in any fiscal 
audit--be it the current model or the projected self-audit format. ^ 

The Existing Audit Process--Description . The audit procedure, 
itself is directed from the Chancellor's Office, "Its intent is to review 
the documentation of all expenditure claimed against state HOPS funds. 
In performing the audit, a team of fiscal experts spends approximately 
10 days to two weeks at an. individual EOPS program-* site, examining all 
records pertaining to^EOPS expenditures,, including botho, finanical 
records and documents!. At the conclusion of the visit, a report is 
pr^epared detailing , the team^s * findings and recofrnriendatioris are 
presented to the EOPS program director. 

t • • 

The present audit process hais two. major parts: a funding* review 
and a progr&n review. These functions are conducted by the on-site 



, audit team, and should be reflected in the final report^developed' by the 

V 

team. • * • - , . _ 

The basic question to be answered by the audit team in the.fUnd- 
ing review is: ^^-Are tfc^e expenditures reported on the EOPS final claim 
format correct and substantially in compliance -with EOPS regulations?" 
The audit te^ carries out two proc^dure# in responding to this 

question: a fiscal audit test and a Title V* audit test. 

\ 

The fiscal audit test reviews the budget accounts to determine that 
the ^EOPS funds are being accounted for separately, and reviews the 
expenditure documentation to 'determine the congruence between the 
amount claimed and th6 documehtable expenditures. 

The Title V conipliance test looks at several factors related to the 
expenditure of funds: eligfbility of students to be receiving EOPS 
monies, eligibility of prcrgrSms for fundfpg under EOPS guidelines, 
payroll expenditures, percentage of personnel time expended on EOPS- 
related activities, eligibility of salaried positions, and costs excluded 
Under' EOPS guidelines. 

The basic question ^o be answered by the audit team in the pro- 
gram review section of the report js: "Are the programs and services 
reported in the approved project in operation and adequately meeting' 
the goals and objectives 0/ the college?"— ; ^ 

In responding to this question, the audit team looks- at whether 
^the personnel exist and the program i$ actu'aliy in operation as planned. 
They document whether there is an EOPS administrate^ directing the 
program, and whether there is an active * and properly constituted 
advisory committee. They review the level of staffing to determine If 
there are an adequate number of personnel to properfy identify EOPS- 

34/ 
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eligible stuttents and track, their progress. They d&t^rmrne Whether 
there are adequate procedures for maintaining audit trails apd for 

* * • 

determining student eligibility. Finally, they examine whether thre are 

^ . ~ ' ''. 

adequate support services to meet the needs of the HOPS students and 

to carry out the goals and objectives, of the college's EOPS program 

% 1' ' ' . ■ 

Results of previous Audits .'^ Some^ype of EOPS program audit' has 

9 

been carried out for over a decade, and during this time, the audit 
results have been mixed. The main audit exceptions in the funding 
reviews have been: awards of aid to ineligible students, improper 
accounting of EOPS funds, and a lack 6f understanding t^egarding 
regulations. While such examples of audit e>«eptions.jcan ^je found, it 
is fair to say that, by and large, the, audits conducted to date have 
shown no major discrepancies. The major need is .for a procedure to 
continue the same "'level of fiscaU scrutiny at a lower, level of ^taff 
effort.. The guidelines from the Chancellor's Office to the audit tear 
for the program review section of' the report inclQdes an appendix 
defining, each of the* terms used. This is to insure consistency* and 
clarity in the reports sy^tem-vvide, ' • - ' ^ 

. An examination of several sample audit ^reporte; s(jows that the 
actual activities carried out by the audit tearu^dld nbi fully "encompass 
each of thesg guidelines. Rather, the audit team appears to havje 
coQcentrated on providir^g detailed examinations of each'^'nrie-ite^^ 
the budget .to judge whether the item compliled with guidelines and legal 
requirements. By followfng a line-item-by-llne-ltem format, the team 

not respond to the question of whether the-prograpis^ and services 
were adequately meeting the "goals and objectives of the college. 
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ThijS program review section pf the report ha^t^^pically turned up 
a number of audit exceptions at* each college reviewed-/. EfXempla^^y of 
the kinds of things noted arfi. ' services to ineligible students*, 
questionable advisory committee fupqtions, and poor'record keepinjg 
processes. - v * J ^ ' ' ^ 

, The problem of services to^ Ineligible students seem3 to be a fairly 
common one: "Students enrolled in this program were, in many, 
instances, high school students Ind- not eligible to apply for federal 
financiaT aid whose procedure's for determining eligibility are also the 
basis for determining eligibility for the HOPS program" ... "Students 
enrolled in this program were-, in many .instances, found not. to have 
completed a FAF form, which js utilized as the basis of determining need 
and thereby eligibility for participation in' the HOPS program". - 

Poor -record keeping processes -were found to b€ responsible for 
several audit .problem^ ". . ..the documentation made' available ♦to'' the 
audit team was Inadequate to demonstrate (these claims)\' ... "in ^addition, 

the purchase 9f (item) ... was inappropriately, r^cdrded under thjs 

• . ' . ' * - ' * * • ' ' f ' 

budget category" .^n^. "expenditure , for student aides should not -be 

recofded here, but should be recorded more appropriately in Pat*ts B 

■ . ■ "* ■ / 

or C.!'' ' ■ ^- V 

The BOPS program .needs -to maintain fts credibility by b^fting able 

to wT^h^and rigorous scrutiny from* the outside. "^Slnce its inception 

. . ' \* , 

however, E0P3 has no^ had a well-defined and strictlyradhered-to 

^ > ' ' r . ' * 

means by which It could be fully ^audited 'for fiscal and regulatofy 
^compliance. In order to begin s^ndardizing the fiscal procedure^ and 
to reduce the number of audit exceptioiYs across all EOf^S programs, a 
special project has been funded to provide a mechanism for addressing 
this common area or needr-\ • . 
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Self-Audit Guide . The Chancellor's Office of the California 

Community Colleges has funded a special project at Sierra Community 

College to develop an audit guide. It is" intended that'this Guide be 

used by, those in the field— directors, business office directors and 

personnel, district audftors, independent auditors, and staff ^f th^ 

California Community Colleges Chancellor's Student Services Section— in 

the 'auditing of their EOPS^,programs. The Guide will be a "working 

^ tool for Jay individuals"r"a^""well-defined .means" of auditing for fiscal 
\ ' ' ^ 

\ and regulatory compliance. Those developip^g the Guide mtend to 
adhere to audit standards prescribed by the American .Institute of 
. Certified Public Accountants, the ptfpart^en^ of Finance, and the 
Chancellor's Office. " ^ * ' 

The Guide itself will have three parts: (a) financial audit of 
'budget activities, expenditures and * claims;, (b) illustrative reports as a' 
result of frscal activities; and (c) regulatory compliance reviews. It 
will also include the following reference checklists: con^Dliance; student 
servlces/(tftrect grant eligibility; regulatory reference material. 

It was projected that the finished Guide will be avaifable and 
delivered to the Chancelforls ' staff for review and d'istribution to the 
field by August," 19&1, with the development team staff available' subse- 
quently for on|-site, in-service. training. A sample of 20 schools will be 
• identified for field review of the audit procedures in 1981-82. Current 
plans call fpr a detailed review of S-S of these sjtes the following yqar 
to make final adjustments in the guide before systemwide. implementation 

is begun in 1983-84; * ^ ' ^ 

* • 

' The Self-Audit Guide should reduce the incidence of audit 
exceptions, whiJe providing \a common^ means .ot^easurement among the 
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various participating 'colleges. It will also provide a common point of 
reference for all EOPS program .personnel . The Guide, does not, appar- 
ently, address the issue mentioned in the Chancellor's Audit Procedures 
for EOPS of whether "the programs and services reported in the 
approved project are in operation, 3nd are ^adequately meeting the goafs 
and objectives of the college*'. ' , 

It is. impossible to determine, at this early phas^in the develop- 
ment of the self-^udit guide whether it might be useful in an evaluation 
system. There is no doubt that it addresses . important issues. How- 
ever, its form and accompanying procedures are far from fi,n?l, ^nd it 
wouldl be premature to dp anything beyond 'making note of its existence 
for future scrutiny. ^ 

Year-End Report EOPS Form #12--Description . 

The^EOPS Program 'Unit ht the Chancellor's Offic^ of the 'California 
Community Colleges requires EOPS programs Vo present a 'Year-End 
Report. This report 4s irjtended to provifle data on the extent t^^hich 
the various program actiV|ities have bfeen 'implemented and the intended 

I 

future status of each activity^i^n^arhe report does riot provide arfy indica- 
tion ' of whetPier or not program objectives have been attained. Thus>- 
in evaluation terminology, the intent \s simply to evaJugte the extent of 
impJementatlon of thie instructional process, rather than the^educational 
outcomes produced by that process. . . 

The year-end report is really quite a simple affair.. Each collie 
is masked to.duplicate the program application description p^ges from the 
project application. For each program description ppge, (typically • art 
objective), the college fills in a Form EOPS #12. 
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Form #12 asks for twp things: (1) a description of how each 
activity listed in the program proposal was accomplished and the pro- 
gress toward accomplishing each objective Jisted; and, (2) the status of 
the activity, EEA's review of a 'sampling of year-end reports reveals 
that colleges put forfh very little effort in ^describing progress toward 
accomplishing each objective listed. On the other hand, there is sofT\e 

self-evaluative data on each of the activities. Thus, colleges might 

/* . . ' ' ^ 

describe the way inr which the activity was conducted, the number of 
. . X . * ^ 

planning meetirtgs held, the extent to which the activity was under- 

taken, or whether there was variance in implementation, etc. This is 

potentially interesting information. However, it is not clear what us^ is 

made of these data. On the one harrd, the anecdotal anS highly ^ 

idiosyncratic nature of the data makes them incredibly difficult to inter- 

pret. On the^ other hand, 'the detail available about the extent of 

purported prograYn implementation throughout the state provides a rich 

^ base for further understanding about EOPS programs. , . ^ 

* • ' > 

The final .columrf of Form EOPS #12 asks fort an indication of :the j 

future status, of each activity. Community college EOPS directors 

^ provide their own estimate of whether that particular activity ought to * ' 

be maintained (M), Reduced (R), Expanded (Jc\, or Dis^con^inued (D). 

Not surprisingly, a sampling of year end reports reveals that, EOPS, 

directors feel that most activities listed in project plans ought to be 

either IVIaintainei|pfOr Expanded. There are very few^^^tances of a — — 

request for reduction. Typically, requests for discontinCiance of an 

activity . follow the inability of the project to implement it; thus \n 

instances where personnel could not be Hired or where the'^actiyity vyas 

simply unattainable', one occasionally finds a request for discontinuance. 



It seems to us, that the futurre status category pi^ovides little in the 

way of usable evaluative data. It may be helpful forHhe HOPS program 

staff at the Chancellor's Offifce in reviewing next year proposals, but it 

does not provide much indication about cfcK'rent year programs' success. 

In part, we^ make this assertion, becau*^ of the lack of guidelines 

/ • , • ' ^ 

presented to program directors In determining future status. In short, 
* " \ ' 

a program director migljt have any of .a wide variety of motivations for 
« * ^ 

making particular judgments abouf the ^ future status of each activity. 

EOPS Form^12"Data Availability and Reporting . No information is 
currently available from this d^ source, becaus:e its use has been 
temporarily suspended for the current ^hool year--pending development 
of a complete evaluation s^j^^m. In the p^rior school year ('80-'81), 
only a^ampling of colleges had "tried out" the procedure. 
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Chapter III 

I 

THE NEED FOR INFORMATION 



All parties (the legislative/executive group and the colleges group')' 
have the^ same major concern . They want to be ah4 to interpret the 
data convincingly enough to indicate whether or not the EOPS program 
hras been "successful." There exist, however, many .differing per- 
ceptions of the meaning of the term ."success," and these perceptions or; 
definitions influence the types of questions asked and the' corresponding 
data-gathering requirements. ' In this section of. the report we vwill 
describe what the, two groups-legislative/ executive and the fcolleges- 
, perceive as appropriate evidence of success. We have derived these 
views from comments made by each group in earlier meetings, as well as 

from follow-up Interviews where appropriate * 

- ■ • ^ \ 

/ ■ ' 
Legislative Executive Branches - 

<■ 

From the evaluation study group meeting and from subsequent 
phones^dnversations with several membe^s not present, some points of 
view have emerged about appropriate information for legislative/execu- 
tive needs. Generally, particip'ahts from the legislative/executive 
branches of government primarily Identify "saccess" as the rate of 
student retention - and the subsequent transition to four-year insti- 
tutions. Transitipn, itself. Is seen the logical and desirable outcome 
pf.the educatrpnal process which begins with recruitment, continues- 
wittj the , formulation of student goals after counseling, and concludes 
with the completion of the* courses attempted in^^^N^ to gain acceptance 
into a four-'year institution.. . \ * . 
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This theme of retention/lfransition recurs throughout ^he course of 
the discussions* For example: 

."..J'm* interested in ^numbers with ^regard to recruiting, reten- 
tion—there are measures of retention, some standard measures, 
class dropout rates, that sort of thing--another sort of measure is 
. the length of timft^it takes a student to complete their objective 

•versus other students ''having simitar objectives--and also what 
their success is when they leave the institution, which we call* 
transition. Those are outcomes that I have aa interest in, and I 
think the legislature would..-." 



Another comment further clarifies this point: 

"There^s a big source of transfer students in community colleges, 
and It really hasn't been transferring. » .and^ia^some base^ we've 
got to get EOP directors to see that thesrT'studlents get in and out 
as soon as possible and go on to a four-year institution.'* 



As a conseqjuence of 'adopting this view of "'success," the data- 
gathering requirements focus around several categories of data: 
student data, program data, and financial/budgetary data. 

Stb<jent Data . Participants in the discussion recommended the 
gathering of a number of types of. student success data. Ideally, the 
measurement of f'success*^ Would Include the following: 

a) Longitudinal data from recruitment to retention to transition 
. b) Numbers of students who go on * to four-year institutions 
c.y Follpw-up studies on students after transition 
d) , Minority representation "In two-year v$. four-year programs 
- < e) Comparable records for both EOPS^ and regular students in 
terms of progress through the system,* grades, units 



^ attempted vs. units compfeted, graduatidn. and placement/. 
Aside from these measures,' a number of sbt|*er comments were made by 
.study group" members about ^iSata problems *or Information needs relating 
to Students. • ' . ' , \ ■ . 
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Legislative/executive study group members generally felt that more 

emphasis should be placed^ on collectrng additfonal anecdotal/descriptrve 

data than has been the case in the past, in order to better understand 

how students make decisions and the contributing factors to retention 

and transition. As one participant stated: 

"My sense is that we get a better respidnse in legislative hearings 
when we have students who are warm bodies there, giving stories 
about their experiences with EOPS, indicating that they're now at 
law school here or there or president of their own business now. 
Demographic data does not really hold great interest. for the legis- 
lature." ^ 
* ^ 

Another participant contributed: 

"I remember one time I went with three students just to visit. We 
had no intention of testifying. It was the Senate fiscal committee 
...the Chancellor's staff was in a state of surprise because it did- 
n't look like they were even going ,to go along with the governor's 
budget request— they were going to cut from there. So I Was 
hustled up, and they wanted us to provide some testimony in 
support of augmentation. And what happened is that my students 
literally got into arguments with (names of fegislators), so that 
was proof of the pudding..." 

Follow-up studies, of students after transitio n (to a higher educa- 
tional institution) are seen as further appropriate documentation of , the 
effectiveness of the program outcome: 

"We've been asking for that (data on follow-up after transition) for 
thVee years. And it seems like, given the fact that it pops up on 
eyery set of budget hearings, it, seems worthy of being incor- 
porated into whatever ongoing evalWfetion "we have.- . .That's ;one of 
the things that strikes me, the .strongest about future budget 
augmentation--would "be to find that EOPS students just propor- 
tionately outnumber non-E&PS in going to state* colleges. That's 
very important." 

* - ' w 
Study group members .also pointed to the importance of reporting 

student data on progress through th^ college (units, attempted versus 

units completed) and retention within the college. Furthermore, a 

Representative from the University of California - noted the desire to 

have evaluation data that would allow them "...to track how U.C. 

' o • ' • 40'' 
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Outreach students^ do in the Comm.unitV Colleges. . would like to be able 
to track and work with these students." 

. It should bB* noted, however, that EOPS students may have very 
different goals from uniformly preparing to transfer to a four-year 
Institution. Although the participants seemed to agree that the legis- 
lature, itself, -would not put priorfties on serving one typef of student 
(those who were pjanning to. transfer to a four-yea'r institution) as 
opposed to anotHfer, they also reaffirmed that the particular issue of 
retention/transitii^n is tTie one which recurs over time. ^For example, in 
response to a question about possible legislative pressure' in one 
direction or another, one participantTresponded that: 

"Well, let's put it -this wayApt^thie extent that you can anticipate 
the policy directions of th^*/egislature, which is very difficult, but 
the legislature has already brought this jssue up for a couple of 
years (retention/tna(?Tsfer)--the extent to which you can come up 
with solutions and- directions, the legislature is' going to be much 
more comfortable with giving you money tb do it." 

* 

Another participant continued., * • - ' 

"I don't think theyVe goin^ to say you^ should have that as a 
' priority, but they're sure going to say hgw are you doing? What 
percentage of your EOPS students are transferring, etc.?' We 
have a problem which has been identified by evdryone now." 

By Emphasizing retentlorh and transfer^ a^"a recurrent criterion for 
"success," much less attention is being paid to the achievement of other 
types of goals in other terms. Tfjus, 'the power of the d^a purporting 
to measure' total "success" in other terms is correspondingly weakened. 

Some further, concerns and comments were expressed by legisla- 
tive/executive study group members about the topic of student goals. 
Most of these comments ^elated to th^ goal data as an inac^equate source 
oY information. The first type of problem revolved around the formula- 
tion of the goal question on the student- data cards: 
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"That's one of the surprises I got in looking at the statewide data 
that's requested'., .they were saying that the categories for goal 
did .not express the kinds of things their students pursued at 
their campuses. So what they -did is they made that particular 
question optional. And very few people responded, I think it is 
•7 much less .than 50%. It's not mandated.": . But the'olher is that 
among the ones who responded, there were a lot who said "none." 
Maybe' that says the question is asked poorly, or it means that 
students are not getting much in the way of counseling..." 

The second type of problem stemmed from a lack of expressed 

goals on the part of the student entering the college. The difficulty 

was summarized as follows: 

"1 can see people coming in and putting down an undeclared major. 
Thefy might say, don't put a particular major down, "even if you 
l^now you're going to declare a particular major, just basically lay 
low your first year, because you 'might want to change your mind. ' 
It's 'better to shift from undeclared than frorfr another major. 
Maybe there is that sort of, 'well, you don'^ have to come up wfth 
a- goal at this point, lel*s see where it takes us.' But the point is 
that you're going to use the dollars better, if people have some 
idea of what. they plan of^ using, their time in school for. I -dpn't 
think it's unreasonable to have a goal in mind, an AA, BA, or a 
certificate in a particular area.. J'm not into the idea pf a revolv- 
ing door. We've got a lot of students gotog ip and a lot going out 
before they've completed any kind of degree, and it's unclea'r--l 
mean 1'jn sure it " has jsomei beaming on their life goals. Well- 
defined goals seems like a real important starting point." 

Many students simply do not know what their goals are and view 
coHege as an opportunity to further, refine and understand their own 
capabilities and opportunities. . This "searching" part of a college 
education is not confined *to EOPS; indeed "undeclared" is the most 
popular ma>or at four-year institutions throughout the United States. 
Hbwever, one study " group member felt that such comparisons are 
inappropriate because the legislative/executive branches demand greater 
evidence of goal direction among college students who are receiving 
special services in state-funded programs. 

A final question arises regarding the "meaning" of student data 



that Is collected, within the context of an ^ "open Access" policy at 
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community colleges.^ Many different types of^tudents now enroll under 

..the EOPS program* These students are not all starting from the same 

point In their development and/or academic achievement level, .yet little 

data has' been gathered on the rates ^f individual student differences. 

ft 

As one participant' stated: 

"...Met's put a minimum GPA requirement'— I thjnk that kind of 
attitude still prevails. And I think a lot of'the legislature doesn't 
understand the ^meaning of open access, the open dqor policy of 
the community colleges and what it is* all about... The other part 
relates to the youngster who has grown up (in a disadv#ntaged 
home) and then gets, the notion to go on to get a BA and a Ph.D. 
You need some data oh what kind of student you're getting in the 
first place. . .ClearJy, the students are poor. And, of course, that 
can have a lot of bearing on other things, too." 

Since the factor ^f^ prior preparation and readiness for college is 
seen Ss having an effect or^ the eventual '[success" of the student in 
terms of retention and transition, the c6nsensus is that more emphasis 
should be placed oh' gathering this typje- of background student data. 

Program and Process Data . Several legislative/executive study 

group members identified the importance of careful documentation of 

services provided with EOPS funds in any evaluation report. \ 

"The argument we make' for EOPS is that it is a Categorical pro- 
gram designed to target- disadvantagecj students, and what are. we 
getting foratfiis? You guys (Chancellor's Office EOPS Staff^), will 
get *up and testify ^hat we get finantial aich— we get counseling 
services, all those sorts of things*' Well, we ought to know to 
what extent those services ar^ being provided and to what extent 
we're getting any benefit out ofJt." ' 

The point is that the *EOPS program, along with most other pro-: 
grdnris,- simply does not^ do 3 good enough Job of describing fully and 
compjetefy the senses that are provided. Legisl'ators need to have full 
and /complete (and understandable) information on what specific services 
^were provided to what specific students in what time frarrte. (They a\SQ 
want to know "with what re6ults"--but,^ are satisfied to a great extent 
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, If the evaluation of services provided is well done). 



This is illustrated by the following example: A legislative repre- 
sentative on the* study group identified the annual report of the ' 
California Coaservation Corps as a model of a good evaluation report. 
This relatively brief report, analyzed by EEA staff ^ documents the 
achievements of the CCC workers in performing public service tasks/ 
public service program objectives, while the' report fails to offer any 
evidence of the implementation of student improvement program objec- 
tivBs and student achievement outcomes, it 'does an excellent job of 
docuQienting services provided to CCC workers and to communities. 
This had a strong impact on the person who saw the report. The 
report also highlights the importance of welhpackagetl anecdotal data, 
as was mentioned previously.' 

A further elaboration of the program services theme is provided by 

those who feel that an important element of relevant 'evaluation data is 

the description of program type and program organization . The interest 

is not only ' in the description of the program characteristics, but in an 

analyses of the extent to which "those characteristics match the. college's 

EOPS goals and are sensible in light of that mission, ©ne evaluation 

study group participant, stated, 

"In other words, l*m also interested in how the program is organ — 
ized to achieve what it is supposed to do. And are there any 
patterns in terms of the number of components funded and any of 
the results that seemingly are achieved? Mm also interested in 
what^type of personnel are' providing the service..." ' 

» • ' • • 

Financial and Budgetary Data . Another area acknowledged to be 
important was fiscal and budgetary data. Study group participants 
npted that auditing the proper expenditure of funds was important, but 
emphasized that fiscal concerns we^nt beyond merely auditing that no 
irrfeguLarities hafel occurred, that regulations had been followed, etc. 
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The types of information generally conceded to be useful in relating 
evaluation to financial/budgetary issues would include data to help 
answer questions such as the following: (1) Wh^t is the. relationship 
between the resources used and the number and type of students^ 
served?; (€) Whatsis obtained for the 'EOPS'^money in terms of program 
comfJon^nts, implementation Of programs, benefits,'^ improvements?; 
(3) What is the relationship between tOPS financially^ per student and 



hidden costs of th|B 



retention/transition rates?;- (4) wfiat are the 
program? 

Participants affirmed the importance of accurately describing the 
financial aids provided tCT students in the program. "After all;" noted 
one study group participant, * "I've never heard any Ojne of those ads 
(recruitment) that didn't mentibn EQPS financial aid." 

■ J ■ ' ' ^ 

^ The. cost-effectiveness ofl E0P6 services was a contrnually recur- 
ring theme. The concern is rejected by the following example of 
counseling procedures at different colleges. (Counseling was only an 
example, the cost-effectiveness issue extends to all services.) 

"The best- illustration that comes to my mind is the difference 
between -.City College (A) and .City ^College, (B) In the area of 
counseling. (B) spends a lot of its money in hiring* professional 
counselors, so they have a very high cost- for counselors. (A) 
spends most of its money on student counselors who are trained to 
provide more minimal functionsf So what I'm intef*este« in 'doin^ is 
looking at what are the expected -outcomes. If you're going to .pay 
five times ^s much money for professional coUtj^eling vsv § peer, 
what do you expect Is going to fare the 'result on the student Xr\\ 
tWs difference?* % .That puts us In the middle of lots of Contro- 
versies) but 'at the moment we don't really have an -idea as* to' what 
they are doing." 

* . . / ' ' ' . • . 

While it has' been very attractive to talk about, the cost per EOP^S 

Student and the* average costs of different . kinds bf services provided, 

these numbers * are deceivingv^here are hidden costs. One of the 

participants provided a caveat; , ' • . 
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^ "One of the selling points. of the program oyer the years has been 
••( ' that it's looked like a bargain. But there^s been'a hidden cost. ^ . 
and that is that those figures don't include the adclitional money 
beijig put in by the ^ college ADA revenues. There is also the " 
^ questiQn of students actually served by EOPS: How_ many students 
of those eligible for EOPS (who didn't get funde5l) ditdn't continue 
in college? 

Thus, it may not be right to consider co2l-effectiveness within the 

narrow limits of EOPS pro^af^ activities. A wider view of these Issues \ 

is likely to. be requjred. This is^illtjstrated in pother way by potential 

"data problem" related to the economic self interestsNof colleges, particr 

ularly with rregard to transfer studepts. As one ^participant noted: 

"In fact, there may be fiscal disincentives (to encouraging transi- 
tion). If you have probleips gettirig students this year, a college 
might suggest that a student come back next year--that students 
♦ be encouraged to stick around. To summarize, I think the other 
part of it is (other than the fadt that maybe theV're going to help 
some human beings get a degree and all that) what is the economic 
, interest of the community colleges?" , ^ * * 

. ' As this person . suggests, the incentive structure at ^the admmis-^ 

trative level may actually work in opposition to th\e*Qpal of increasing 

^ transition rates to four year colleges. * 

f As was suggested at the outset, the legislative/executive study 

group had very basic concerns in three areas. The preceding dis- 

cusslop illustrates, their focus ofc student data (particularly' measure's of 

retention and transition)! pro^ram^ data* (with a focus on documentation 

of services) and fiscal and budg#fr^ata. The next section will describe 
«• * . 

# * f« ' • 

the *colleges^ study grouf)*s point of view of the types of information 

needed in jan effective EOPS evakjation system. 

Collies ' • . , 

i Several types of information needs emerged from, the discussions 

with participants representing the colleges^ point of view. Many .were 
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similar to' those expressed by -the' legislative/executive, branch partici- 

» » • ♦ ' * » * 

paots. One obvibu^' difference, i^however, was' that ' th^re -were ^many 
(and broader )* perceptions, of ^what could be CocvsideregJ^ "success" by 'the/* 
colfeges group. ^ 

Participants agreed that' t'helr basic focus in^ measuring . prograrrf 

outcomes accurately is to- justj^^th^e programs themselves anql to help 
. ' . , •> . * ^ ' ^ \ . 

both the local campus and the statewide system, im'pYc3ye program 

* planning. *. * • . ' ' • ' ^ ' ' ' 

* \ ^ ' . • 

^ "...there's two thfngs that; have been surfacing,. We definitely 
'^ -\ warrt inforn^aUon^fo'r expTaml^ justifyiag the programs, . state- 
o . ^ yvide. or lotaif;anci ajso.^we want piore Inforrn3tion to, help the local* 
carnpus or . statewi^^ Ifnprove planriingr And around th^e two 
. f#ctQrf, .. -planning ^nd justtficatiod. /.we need Information that's 
^ gdiog toimeet both of those' neetisJf > 

two Issues efaborated require both d^a about students 

and^l^pa *abo'ut program prgahizatlof^^lgyd resource usage. Althipugh 

^x^%^ t^^r^ is a cerl^Ki a(Tiount of overl^p^.w^ vvtll organize our 'discussion of* 

X. ^ ; «th^. Irtfbi^rtiation nefeds in terms of. thes^two/categories. 

' ' f../ Stua9nt''Datar One dominant theme that sounded throughout the 

varlpus,convi^satior^t.^ith Jhe college leVef evaluation study group was 

the- colleges need fc^-,rt\otieKfnMrr^Sitthri'^^hai) is presently available.* 



College study/groiJp Siembers' also^ expressed concern about the'^uality 



of data that 'was available* and^^w^d^^t^^^yprocedures foT* gaining access 

t4 ? 



?tate-collected data. |The c@H^e^sti4fly group members provided 
^ some detail as to the. type of inform^oi^ they desired.. The informat;ion 
type"i can be classified as follows: i W^gl 

a) background information orK^t^ ^stud^n^s startfng point before 
he/she enters the EOPS progVam*, 

b) reliable information on srecten l qoaL s^r t 

^ • ■ ' ' •■ . ■ 50- V 

ERIC ^ _ \ ^ ... 
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^ • c) comparative data between EOPS students'^and regular students 
in terms of number of unit$. attempted/completed, goals and 
retention rates, . , ^ $ 

d> demographic information 

^ * • 

The colleges need more background information on the starting 

RQ'rit of each student because of difticulties in interpreting retention/ 

transition rates. At one^ participant commented, ' , 



"It may be tfjat cjifferent colleges are serving different student 
groups... Tm ju*st simply saying that we need to think of §om% way 
to be able to get better understanding of the meaning of the 
transition data,- and for that reason we've got to have some better 
understanding of differences between student groups at different 
colleges. " 

Another participant questioned whether: 

"...in terms of looking at the unitsii«attempted and completell, we 
should adjust to the type of student that's actually being retained. 
Thus, the starting point of students is importaot in understanding 
reffention." ^ . . ^ 



One ^problem with the existing information on stud;ent goals arises 

from poor question formulation on the student data cards ^ • 

' ' ' / ^ ^ 

"...the student information system now asks f6r student goals as 
an optional- item. Very few peopfe respond *to iJ^i^Among^^hose 
who do, over half say "unknown" or "don't^knoW^. Superficially; 
that looks odd that so many ^tudents would not know what they're 
therefor^ but what jt more typically means is (that they wanted to 
^espoTTfl; "none of the above." Our tools are not sensitive enough 
to pick those up. So we're just missing it." 



Members of the colleges group concur that retention and transfeK 

7 

are appropriate dimensions for the measurement of success.' But they 

caution that^ it is naive to consider these data without an understanding 

of student goals and student educational and home, background factors. 

As one participant stated;^ 

"See, we don't have aiSy^information that w.e could say, now- wait a 
- minute--this particular group of students has been characterized 
as having the need to be In remediation for up to a, year and a 

K 
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half^ before they enter into the regular programs--that sometimes 

happened. So you just can*t take a straight- out comparison of 

how many .with given goals start out in year one and are done by 

year three, or year two. The^community coMege students, HOPS 

students included, are not homogeneous. Although in HOPS, 

there's a tendency for people to think of these students as a 

homogeneous group, they're hot.'«And, we don't really \iave any 

indication of what those differences are." 
% 

Another participant pointed out that. 



"...there is another question of success refuted to the types of^ 
things we've been discussing--retention data, wfiat^a^ when"^ 
they leave? What are the transfer rates of the EpPS students? 
And so forth (looking at these kinds of questions) that strikes me 
as being a real ^ dangerous'^practice If it were done unqualified 
(i.e,, without knowledge of student background and goals)". We 
have some programs that serve any ^student who meets the income 
criteria. And we have other programs .thft deliberately set a 
priority on .students who are exceptionally high risk... And then 
you 'mighjt looK at retention, or^the length of time it takes for the 
student to progress through school (which is another measure .of 
• ' retention that is often used) and again come to a false ^ conclu- 

sion... Or, where are they three years after they entered? We 
might wind up wjth many false conclusions that one program is not 
doin^^s good a job a.s another if you just compare outcomes." 

Another d<f|[iculty with measuring "success" by re|ention and transition 

rates Elates to the problems of changes in student goals. For Acample, 

"A student comes in and says thaV his goal is to be here for one 
year to improve his skills and gek a job and they're there and 
they, improve their job--is that' suosess? If a student says that 
his goal is to transfeV to a four yea\ institution, but then at .the 
end c5f one year doesn't transfer to^ four year institution and 
drops out and gets a job--is that success? Or is that a function 
of whether the student's initial goal was realistic? If a student 
says that his goal is to be here and get a^two year credential, but 
then transfers to a four yeaV col lege-riV that super success?" 

^ Program and Resource Data . Participants panted, out that the 

cpllefges have a multiplicity of missions . As a result, it is difficult to 

jneasune program success. 

"The community colleges serve multiple purposes compared to just, 
transfer and vocational education. There are community services, 
and a lot of student service programs, certificate programs, 'etc. . . 
Something 'has happened to the community colleges ar^d it's difficult 
for legislators to get a focus on what its mission ^js, because it 
seems that there's not a lack of mission, there's an abundance of 
missions." , ' * 

ERIC ^ 52 ' ^ 



College representatiyes also pointed to another ^mension of the 
problem: making othfr parties^nizem of this expanded mission. As, 
"one. participant stated, * ' 

^'Thjs is certainly a big problem, becayse as you know, the comr 
munity colleges are under attack right now for not transferrinq as 
• many as they did 20 years .ago, 15 years ago. And, up here the 
perception is that we have a probjem,' we don't know how big, 
with the legislature, which tends to see the community colleges in 
terms of the master plan that's 20 years old, rather in terms of 
what me- institutions -have become in the intervening time The 
community colleges serve multiple purposes..." * 

Another issue brought out iy the group is the' problem of whether 

programs are serving the "appropriate" participants. Appropriateness 

is pactially a fuj^Tction of the mission (or purpose) selected^ In addi- 

tion, no clear cut guidelines detail, how selections should, take place. 

As one of. the participants defined the problem, ."You migj)t be helping 

1^,006, but sis it iQ^fact, the group you should be helping? The ques- 

tion- of which group should be helped is, pf course, a nebulous one -and 

open to substantial debate. The current guidelines for the program 

provide, indication -that participants with highest priority are "first time 

\tudent with the greatest need." The question, of course, of what is 

"greatest need" is still open to debate--and to individual interpretation 

by each college. As one study groups member noted :^ 

"The need of the community' is what defines the highest . priority 
student needs at your college." 

Aside from accurate description of the population served and tKe 
appVopriateness of programs, colleges also want to be able to mak^ 
claims about success in terms of program ^ outcomes^ . Participants 
pointed with^ frustration, to ^e inability, thus far, to differentiate EOPS 
py*ogVam effects: ^ 
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"...you resort back to general outcome measures. 'You wind up 
making an assumption that if there are differences, and rf HOPS 'is 
a major service area that other students are not benefiting from, 
that you can claim that ^cfme of 4J: (some claim' all of it) is due to 
the program." 



Again, study^j;:oCjp members felt the necessity for certain, kirrds. of 

evaluation data to describe program effectiveness. Transition was 

« « ■ 

mentioned as convincing evidence of program impact.^ As one parti- 
cipant pointed out; , ^ ^ ^ 

"I think* the transition of our students is ver:yomportant. If we 
can find out, e.specially on a state-widiB Jevel,..,but f think it'd be 
very interesting to know how our students do as they transfer on, 
and what percentage of pur students transfjer, I think that would 
be valuable informati6n for EOPS to have, not only as ammunition, 
-if we could shoW that 15, 20, 30 percent of £OP*S do make the 
transition- froowrommunity collegesHo a four-year college, because 
we know that somewhere fronj 3 to 7 percent of the l^egular 
* students make that transition." 

Another participant continued along the same line of thought: 

"But my big concern right now- Is^ .the transltionr-the movement 
^fpom the 'community college to the •fbar-year ' scene. . . I think what 
we don't know is the definite Impact statewide that ^the program is 
having, and on the other hand, the transitioh--how many of our 
students are actuaflly pe/slstlna and getting into a four-year 
school.". . . > ^ r 



a rokjr 
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Although we have alluded to this in other sect^ons'of this paper, 

/"^^^ ' ' * 

it Is important to"* note that members of the colleges* study group alsp 

pointed to the need fai>feaslc program demog||[&phlc data.» The following 

data Illustrate the -kinds of information that would be useful: 

Number of students who applied for admissfon 

^ Number attending class * 

Number' persisted beyond flrs^Oiensus week 

- Total dropouts 

Financial ^id 

" Registration : day/evenfng/ocdapational 
Etc. . ' , ■ 



AlsO; of great^mportance is" a descriptidn of the way that pro - 
g^^n^s are organized . It is^ important to document the .characteristics of 
prbgrams.. One participant noted that it is important to provid.e "a 
picture^ 6f the way various programs have organized themselves in terms 
of the functions they're addressing and the kinds of activities they're 
engaged, in." One participant cautioned, however, that there - is a 
ddoger in this procedure. There can be "an implicit message that this' 
is the kind of thing you ought to do"; Such an assessment could 

inhibit a campus' from developing different types of programs to serve^ 

( ' ' ' ' * 

the particular needs of its students in favojr of installing an existing 

program wKich might not necessarily b'e the most effective. 

"I 

A better ^jnderstanding of the utilization of program services was 

often mentioned by the panel. Which elements of the EOPS program are 

• • • * 

selected by which students? All participants agreec^hat they needed a 

.clearer idea of which programs student^ chose to take, which program 
component^ wer successful, ar\p w^y. In addition) they saw great 

• benefit frcjm having comparative student/program data systemwide. 
However, tKey felt that the present system of data collection and 

'analysis ^ was not providing thi-s information. There is a very clear 

■ • ' / 

indication from the colleges study group that data^of this type would be 
welcomed V for local information purposes and would b6 ijnportant for 
program legitimation. ' ^ . . * 

The topic- of fiscal resources was prominent among the issues men- 
tioned by college participants^ An accurate summary of prog f^ff\ costs" 
is in valuable ""to the schools and is an important itemUn describi ng EORS 
to the* legislature and others. At the most basic level, data ought to 
be available on each collegers allocation and*the Tiumber of documented 
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eligible students. iMore general fiscal .descriptions of the funds 

'allocated to different program components are also seen '.as valuable 

information by the colleges. Comparative fiscal data can serve as a 

useful guide to what \other colleges are doing.^ One participant* noted: 

. "I would like to have comparison information ^eyond what I might 
generate at the local level. In particisilar, I would like^o see 
statewide data on amount of money for direct aid versus amoiint 
for services, the?i within services the amourfts for counseling, 
tutoring, basic skills, ^ettf. ' - . * 

Several of. the participants pointed out that data conq^rning the 

relationship of fiscal resources to. categories of services woui'd be help- 

ful in determining how the'EOPS monies could best be utilized. As one 

participant states, w ■ ' , 

>v . ^ ^ ^ — 

"...all of this is part of the current era... where people are going 
> . to have«.to nxake better use of 'the monies they've got because it's, 
apt going to be cdmlng in. large increases as it did in the last 
•decade." 

• ^ • ■ ' ^ . . ' V ' . ■ ' ^ 
Most of ^the participants also- saw another dimension to the fiscal 

is^'e.^ The?e is a nefed for better understanding of the .Terationship 

between studetit background and' fiscal resource" requirements. Study 

group partrcipSnts fee4 that if they- "had information that would indicate 

that there are* important differences in the needs of stqdents ...wher^ 

they must be served longer if they're going to^suceed, it puts us in a 

stronger position" to fergue for. dollars." One participant further 

analyzed"' this prbbjemri as follows: * ' y • ' 

"We have gone through thr-ee years of an agreement ' which -was 
. struck between the Governor and the Charicellor'^s Office about the' 
Jev€tl of funding "the Governor* would > provide- for the EOPS pro-, 
; gram. The agreement^was that he-would' allow sd many additional 
students to be served, and a fbr/riUla- was devised to''*be able to. 
provide^money to students- who had entered -the program, in the 
previous year/^'and those who were'contihliing in the second year, 
for a perioo' of ^three yearsr-'that's called^ the ripple formuia-- 
well, the agreement's up, it's over. So we're now ii^a, position 
where we're.going to have to, in effect, Renegotiate a process, ^a 



mechanfsm, for ^generating- new resources from the state pie. Now, 
Jt's jny feeling. . .that if we are facing the situation where- students 
, need to continue ip.the program longer, or there is ^ need for 
more students. . .well, that implies a completely different mechanism 
for requesting augmentations." 

Comparative data is seen as a desirable additional piece of infor- 
mation which has not always' been collected io the^ast. Two types ^of 
comparisons are desired: (1) statewide comparisons of different EOPS 
programs; and (2) comparisons of EOPS with regular college programs. 
* What 4s being discussed, here is not ,so much' the nature of the data to 
be collected, as the manner in which it might be anal-yzedT 

Some of the participants felt that statewide comparisons of EOPS 

programs could be a politically sensitive issue u "There's a comparative 

issue here, whether (or not) we're going to yse this. data as a tasis for 

making comparisons of EOPS with the general student populati6ns--now 

that gets into shaky political grounds." A further comment made on* 

this pointy" # 

.There is a fair amount of data generally available that can be 
used for comparing EOPS to itself, (cplleges with other colleges). 
" We could tcfithat now. What we can't, , do now is compare EOPS to 
the student body, because, the general studeijt information system 
does not include, fcyglr instance, data qn units completed. We only 
collect that iniFormation state-rwlde on EOPS students." 

The colleges study group echoed many of the concerns of the legi- 

slative/executive group, but they saw a number of additional information 

needs. Notwithstanding the difficulties, the consensus was th^t it 

would be helpful to be able -to obtain statewide data conceCrning: the 

overall pattern of the program/student -gqals; program descriptions; 

EOPS vs. general student data; and transition/retention rates. Also 

seen as useful information, would be a clear description of what the 

colleges' .r.ecruitment plans are, 'arid a gfeneral understanding of past 

historical trends. 
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Chapter 'IV 



STATE'WIDE EVALUATION OF EOPS 



This section oif the report compares the EOPS% program data 

/ 

sources >(Chapter II)) with the EOPS information peeds' as envisioned by 

. - \- - I 

the two study group's (Chapter III). The correspondence between 
information nee^s and existing data w<ll elucidate the questidns of 
interest which can currently be answered. Furthermore, the com- 
parison should point to the mafor'data shortfalls of the current EOPS 

cx 

evaluation system. As will be noted, while much excellent and valuable 
data exist, there are some major discrepancies between needed data and/ 
data that are currently available. 

Existing Evaluative Information 

The existing information sources ^fr^m Chapter II are summarized in 
Table 1. .The data have been categorized into five areas: student 
background characteristics and demographics, student academic informa- 
tion, EOPS program characteristics, EOPS service levels, and financial 
aid to students. ^ 

At first glance. Table I appears to suggest that almost everything 
anyone might want to know is collected in one fashion or another, but 
this Impression is misleading. The footnotes at the bottom of the table 



point out some of the limitations of the existing data. Much of the data 
are either , unreliable,* not coded for computer analysis or collected on 
only a small number of colleges each-year. 

There-- are two important exceptions; the fiscal and the* USRS 
reports are both reas^ably accurate and readily accessible. The most 
accurate and useable datqt is that obtained from USRS, relajting primarily 
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TABLE'1 
Existing Evaluation lr>formation 



DATA ITEMS 



DATA SOURCES 



Student Data 
.Cards^ 



USRS' 



Application 
Form 10^ 



Student Background Char - 
acteristics and DemograffThics 

Sex ' 

Age/Birthdate 
Racial, ethnic group 
Martial status 
Financial need 
Residency 



r 



X 

a 

X 
X 
X 



EOPS Student Ac^^demic Information 

Highest grade completed 

Declared major * * 

College of last attendance 

High school diploma? 

H*sr of last attendance 

Academic standing 

Units attempted 

Units completed 

Academic status at 
beginning of year* 

Year GPA 

Cumulative GPA 

Academic goal (OPTIONAL) 

Accomplishments (OPTIONAL) 

Overall college with- 
drawal rate 

EOPS Program Characteristics 

Number of components 

Types of sub-activities (27 types) 

Needs ' , . ^ 

Component goals statement 

Activity descriptions^' 

Estimated number of students served 

Actual numbeLELof students served 



X 
X 
X 



X 
X 
X 



X 
X 
X 
X 



X 
X 
X 

X 

x^ 



X 
X 
X 
X 
X 



X 
.X 
X 
X 
X 
X 



V 
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TABLE 1 (Continued) 

PATA SOURCES 



Student Data 
a * 

Cards 



USRS 



Application Fiscal 
Form 10^ form A-1^ 



EOPS Service Levels 

Resources per component 
(by object class code - 
9 components) 

Resources per major category (by 
object class code - 3 categories ^ 

Resources per Activity (by 
object class codd - 37 activities") 

Personnel per component 

Personnel per category 

Personnel per activity 

Estimated numbdr of students 
served by component 

Estimated number of students 
'served by category • 

Actual number of students « 
. served by categbr>J^ * 

Districts* financial contri- 
bution (actual) 

Distrists' financial contri- 
bution (estimated) 

Counseling hours (EOPS &. 

hon-EOPS combined) ' 

Tutoring hours (EOPS & 
non-EOPS combined) 

Recruitment hours x 

EOPS, counseling hours- 

EOPS tutoring hours x 

Financial Aid to Students 

Student need x 
Financial aid from 

. eacfv source ^ > x 



X 
X 

X 

X 



X 
X 
X 
X 



Note 
a 



Refer to previous section for a more complete discussion 
Student data cards are no longer being used, and have low reliability, 
USRS will first be fully implemented in 1981-82. 

Application forms reflect projections,, not actual expeditures; only fiscal 
elements are coded for computer access, not program characteristics. 

Fiscal forms are not coded for com'puter access. 
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to student academic success and the level of individual student ftnancial . 
aid. As we *will s«e later, these are the twd ^eas ig which a compre- 
hensive evaluation system is best supported by current data collection • 
efforts o ^ . 

Necessary Information for Evaluation Questions 

> 

In Table lU we -^have categorized the^concerns expressed by the 
study groyps into six major questiorfs of interest. In addition, the 
.kinds 'of information appropriate^ to aqswer. each question have been 
specified. The six major questions are: 

1) What are the background charweristics of the EORS popula- 
tion, and how do these compare 'with non-E.OPS students? 

2) ^ What are the elements of the. HOPS program, and how do 
these compare with services offered dutside- EOPS? 



3) What level of services is provided in HOPS programs? 



4) How are HOPS resoqrces expehde^? 

5) , How successful are EOPS students (during their tenure in the 

college, and how do .they compare with nor?- EOPS students? 

6) How successful are EOPS stud^ts when they leave the com- 
munity college, and how does this compare with non-EOPS 
students? > • 

A cursory glanc^ 'at.Tafele II may give the misleading impression 

i 

that most of the information necessary to answer these questions will be 
found among the d^ta that are currently collected on EOPS programs 
and students; indeed, the information categories have a striking similar- 
ity to those in the first table. The apparent 'data match' partly results 
from the use if simijar terni^in both tables. The tabular format further 
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TABLE II 
Desired Information on EOPS* 
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QUESTIONS 



RELEVANT INFORMATION" 



What are the background 
characteristics af the EOPS 
population? 



^ a. How do these compare with 

non-EOPS students?. ^ \ ^ 



Prior school experience: 
High school diploma/ 
1 certificate 
" High' school GPA 

College G^A 
Age 
•Sex 
^Race 

^ Parents* education level 
Parents' income level 
Studen^ income lievel 

Same 



2,\ What*are the elements of the 
' EOPS Program? 



a. How do thfese comparfe with 
services offered outside EOPS? 



Community heeds * . * 

Program components 

Activities 

Services offered 

Number oftype of personnel 

Organi^ational^structure 

Same / 



3. What lever of services are provided 
in EOi?S programs? 



Recruitment arctivities . 
Instructional support 
Tutoring hours 
Counseling 

Administrative activities 
Otherj^ activities 
Financial aid to stu<iehts 



4. How are resources expended? 



Cost per category 
Cost per component 
Cost per activity 



TABLE II (Continued) 



■QUESTIONS 



RELEVANT INFORMATION ' 



Hpw successful' are EOPS students 
jduring their tenure in the- college: 



How do they compare wl'th r 
'non-EOPS ^tudeats?. 



I.n terms- of their own go^ls: 
Student educational goals 
In other academic terms: 
Units attempted/Units . 

completed 
Academic standing 
^ . Cumulative GPA 

Term, GPA ' ^ 

Drop-out rate/retention 
rate 

A.S. or A.B. certificerte 
attained? ^ ^ 

Same^^ — 



6, How successful are EOPS students * 
when they leave the community 
college? j 



How does Jhis'G6mpare with 
non-EOPS students? 



In t^rms of their ijown goals: 
' 'Student goal' staferftents 
In ^th^r terYns: 
VbcatU>nal skills 
Job* placements 
.Transfer/transtition 'to • - 
four-y^ar institutions^ 

"Success after transitior^ 

«k . ft 

Same/' ' - 



•Desired information could provFded by program, comparisons 
between programs and comparisons wi|h statewide data. 
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suggests that each question has equ^jV importance. In reaflty this is 
not the case: the questiohs for which the greatest amount of informa- 
tion is available are not the ones stressed most strongly by the study 
groups. ' ' 

This, picture will be clearer if we consider each of the six-ques- 
tiorrs/ comparing the information ttiat would be neces^s16ry to answer the 
questions with the available data. It is interesting to examine which of 
the' six evaluation ^estions prelented in Table II can be^answered with 
in.formation currently being collected. This will provide a more accurate' 
appraisal of the gaps in the current data as the basis of an HOPS 
evaluation system. 

' ' ' ' 1 - • 

The usefulness of e>:isling data for answering the questions/of 
interestQs shown in Table II l--Availability of Desired Information. The 
broacf evaluation questions are presented in column one of the table, 
and the types of , information that would be /f^eeded to 'answer these 
questions* are shown in column- two. All existing information sources 
that provide, such measures are^ cited in column three, and those 
•Sources that are both reliable ^nd computer accessible are indicated in 
column four. Specifically, column four provides an answer to the data 
useability question. Only those data sources for which the answer is 



"yes" in column four properly contribute to an evaluation system. 

Avaiiapiiity ox pesirfei ' ' 
the background characteristics of EOPS students. Members of the 



A\?ailability of Desirfed Information . Jhe first question deals 'with 



study g|K)ups felt Jt. was Shportant to document more accurately the 

entry charact.erlstics of the ' EOPS population. These data might be 
« 

refevant to an analysis of the appropriateness of EOPS services, the 
expected level of €OPS outcomes, etc. Both the research literature and 



TABLE III ^ 
Availability of Desired Information^ ' 



QUESTIONS 



releVantmnformatipn curre^jt A.VAI lability 



USEABLE IN CURRENT FORM 



.1. What ana/4ixe back- 
ground characteristics 
of the population by 
EO/PS? 



Prior school experience: 
high school diploma/ 
certificate 
high school GPA 
(priojf) College GPA 

Age 

Sex 

Race 

Parents' incomi^ tevel 
^Student income fevel 
Student finajjcial need 



USRS 




USRS 


Yes 


USRS 


Yes 


USRS 


Yes 


USRS 


Yes 

* 






USRS 


Yes 



a. How do these 'com- 
plbre with npn-EOPS 
K students? 



Same (except f6r 
financial need) 



Same 



SaVne 



What ape the elements of 
the EOPS Program? 



Community wieeds 
Activity goajs 
Program components 
program subcomponents- 
List of activities offered 
NumbeV* of type of 

per^nnel 
Organizational structure 



Form 10 (program) 
Form 10 (program) 
Form 10 (program) 

_^^Form 10 

^'^Form 10 

Form 10 {program) 
Form 10 (program) 



2 
2 
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How do these compare 
yith services offered 
outside HOPS?, 



Same 



TABLE III (Continued) 



QUESTIONS 



RELEVANT 



INFORMATION CURRENT 



AVAILABILITY 



USEABLE IN CURRENT FORM 



3. What level of services 
are provided in EOPS 
programs? 



Actual/estimated number 
of students served 

Recruitment activities 

lnstructiona»l support 
'Tutoring hours « 

Counselfng hours 

Administrative activities 

Other activities 

Financial Aid to students 

Work-study grants to 
students 



Form A-1, Forxn 10-" 

Form 10 (progVam^ 
Form 10 (program), USRS 
Form 10 (program), USPS 
Form 10 (program), A-1 
Form 10 (program) 
Form id, USRS, Form A-1 

USRS ' ^ 



1, 2 

Yes 
Ye6 
Z 

Yes 

Yes 



4., How are resources 


w 

Expenditure per category 






9 








expended? 


(A, B, C) 




Form A-1 


9 




1 






Projected cost per 
component (100-900) 




Form 10 






2 






Projected cost per 














• 


" activity (37 levels) 




Form 10 










District contribution 




Form ^-1 






1 





5. Hovy^ successful are EOPS 
stydents during their 
tenurfe at the community 
col'lege? 
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In terms of their own goals 






Student academic goats 


USRS (Optional) 




In -other academic terms: 




Units attefnpted/units 






completed^ 


USRS 


Yes 


Weekly student contact 






hours 


USRS • 


Ye3 


Positive attendance 






enrollment 


USRS 


Yes 


Student level 


USRS ^ ^ 




Academic standing 






beginnmg/end of term 


USRS 


Yes 




>TABLE ^ll (Cpntinued) 



QUESTIONS 



RELEVANT INFO/^MATION CURREI^T AVAILABILITY « USEABLE IN' CURRENT^FORM 



5. (continued) 



Cumulative 'ePA 
Terli- GPA ' ' ; i 
Drop -01^ rate/reter^tion 
? rate , « J 

ft A^.S. br;_A. A..*certi/i-. 
^ . 'cate- attained! ' 



USRS 
USRS 



Yes 
Yes 



How do these 
compare with 
non-EOPS students? 



Same 



USRS (Only academic 
goals: units attempted 
and weekly -student 
contact hours) 



Same 



How successful ar^e 
•*EOPS students when 
they leave the com- 
* munity college? 



In terms of their"own gopls 

Student goal statements • 
In other ter^s: 

Job placements 

Transfer/fransition to 
four-year institutions 

Success after transition 



a* How does this 
compare with non- 
EOPS students? 



In terms of their own- goals: 
Student goal statements 
Other appropriate meas- 
• ures 



I 
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Desired information could be provided by comparisons between EOPS and non-E(3Ps 
programs and. comparisons with statewide data. 

NOTE: 1. Form A-1 - Reliable but not computer coded. 

2. Form 10 - Rrojected levels at time of application 

3. Optional elefT)6nt in USRS Low response rate 
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common sense* sugge«t that it' would probably be most important to 
consider educational and socio-economic variables. The current system 
does provide some information on racial-ethnic background, ag/ and sex 
Of each EOPS student. it also provides, .a gross measure of prior 
academic performance .• by indicating if the student- has a high school 
diplQnnS and if he or' she has previously attended a colleq^e! But more 
meaningful measures of academjc performance, such as high school GPA 
or coJIege GPA are not collected. Similarly, no information is collected, 
on ■ socioeconomic indicators (such a parents' income level, parents' 
edu cation ,r etc). As a result, only the most cursory description of the 
background characteristics ^ of EOPS students can be drawn from 
ex*isling information. 

D^ta on race and p/ior academic experience are part of the common 
USRS data elements gathered from all community college students and 
,^thusr provide a basis for examining potential differences between EOPS 

and non-EOPS populations. However, data on*academic accomplishment 
• * \ * * 

and financial "aid ^are unique to the EOPS data forms. USRS does not 
gather comparable data on -non -EOPS .students. While such comparative 
information-^ might exist* in some other 'form* in some- other location, to 
our knowledge, it does r^ot. This -is uhfortunate, because . potential 
^comparisbns" between^ EOPS and^ non-EORS ?'tudents are' important to 
many rtiembers of the study groups. . \ " 

The second question i^ directed toward description of the EOPS 

< / \_ ' ^ 

program components . What are the* elements of the EOPS program, how. 
do they meet the needs of the students and how are they organized? 
The most extensive and most detailed description is found in the pro- 
gram 'application (Form 10). The drawbacks of the prpgramatic data 
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reported in Form tO are twofold.: (1) they are not presently coded f6r 
computer storage and access; (2) ther^ are no syst^JSriatic revisions of 
the descriptive sections of the application in ligfU^of actual blidget 
allocations.. Analysis would ne.ed to be based on the "proposed*' pro- 
gram description only. Thus, many of the more interesting questions 
on program organization could only, be ans>vered after a great *deal of 
coding and analysis work--and then only "approximately!^* 

The only other sour^ce that maintains any programatic distinctions 

4.' 

are the fistal forms (Form A-1). However, they actually contain very 
little about the organization of program activities. Form A-l disting- 
uishes only three "major components," rather than 37 activity sub-areas 
as describpd in the 'program application. Thus, only the unsatisfactory 
Form 10 data are really relevant to questions of HOPS program develop- 
ment and organization. The comparatrve question is equally difficult to 
answer; we kn^ little about the program characteristics of special 
services provided for non-EOPS students. 

Two other questions with slightly narrower focus can be 
answered more successfully using information from the existing data 
collection systems. The first of these j^lates to the levels of EOPS 
services provided to each individual student; the second to the fiscal 
resources ^allocated to each &f the services within the colleges. 

» First, we will consider the. direct measure of service level hours 
of tutoring and hours of counseling provided to each EOPS student. 
These two pieces of data are reported on USRS. (Recruitment hours 
were estimated on the old Student Data Cacds, but the estimates proved* 
to be quite inaccurate and the Item was not retained in the switch to 
USRS.) 'Even here there is a problem, however , -'because tutor^g and 

. • • " > 72'' . 
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counseling hours^ are reported as a combined total for HOPS and non- ,. \ 

HOPS services, and it is impossible to differentiate between the two. 
Thus, for each student there is some measure of EOPS services 
received, but not a perffect one. * ' - ^ 

As an alternative, one can measure EOPS services aggregated at . 

.the college level in terms of the dollars expended, in different areas 
using the application form (Form #10) and the fiscal forms (Form A-1). 
It is. possible to answer the question of how EOPS resources are 

•expended collegewide with a fair amount of accuracy. The budget 
sections of Form #10 are computer ^ded (unlike the program descrip- 
tions) and there is easy access to this data. Though not computer 
coded. Form A-1 might be useable to check changes in expenditure 
levels and adjust Form 10 projections. This would require some extra 
work, but not as much as analyzing the descriptive sections. Thus, ^ 
describing the expenditure of' EOPS funds by activity (with fine tuning 
only at the aggregated level of 3 major program categories) is one^^sk 
that can be performed \yithin the current data collection framework. 

When we turn to the question of -EOPS students academic perform - 
a nee more extensive information is available. USRS provides a number 
of useful indicators of success. The number of units attempted an^ 

completed are the most direct measure. That, combined with=Hpsimy.latjve^ 

*• ^^^^ 
GPA and term GPA, allow us to develop a fairly .accurate bictare of the 

short-run' academic success of EOPS students. 

^embers of ^he study groups suggested that ymparisons of the ■ 
educational success of EOPS and non-EOPS students- might be an impor- 
tant measure of program success,. The common data elements of USRS 
do not include measures of units completed nor of GPA. T*^ljs, unless, 



V 



72 



68 * 



these figures can be obtained from some other source, no direct measure 
of these data on non-EOPS students is available for such a comparison. 

. Another academic item that was suggested is a comparison of 
drop-out rates among HOPS and non-EOPS students/ We surmise that it 
would be possible to compile figures on EOPS drop-outs using student 
identificatiori -^umbers from one term .to the next (though/it is not clear, 
how one^ differentiates betweeh drop-outs and gradu^es). Thp other 
i^lement in the comparison^^-the overall college withdrawal ra"te--was one 
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the pieces of information collected on Form #3 of the old Student 

Dat^Cards^ but it is ilot collected' under USRS. It^s possible th^t 

these data could be. acquired for nbn-EOPS students in a manner simHar 

to that described fqr EOPS students. If*this is the case, comparison of 

withdrawal rates among EOPS and non-EOPS, students wogid be possible. 

As a final note, we find it hard to believe that better measures of 

non-EOPS student academic performance ^re not available somewhere. 

While such information does not appear to be jpart of the six ' information 

sources we reviewed,^ we suspect that such data is compiled °th some ' 

form- As a consequence, we will leave the question of comparable 

academic performance data on non-EOPS open for * additional ^ 

> investigation. - • ^. » . ' ( - * 

The sixth question suggested by the slTddy group may be the most 

important one. ^Certainly it. was the issue addressed most often in our 

discussions of the EOPS evaluation system. .The question is, what is 

the success of EOPS stu3fents. when they leave the program? Do they 

achieve their personal educational goals - an associate degree, voca- 

tlonal' training, job placement; etc. What is' the overall EOPS prograit) 

success \f\ preparing students for transition to four-year colleges? How - 
■ V . 

; . , v 74 
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do HOPS students pompare with non-EOPS students in achieving - such 
goals? 

Very little information is available about students' p'ersonal goals. 
USRS has one item regarding student's academic/vocational goals. 
Howev.er, it is art optional item. If past experience with the 'Student 
Data Cards is any measure, we should anticipate a very low response 
rqte oh this question. As a result, we will have no dependable measure 
of the students* own goals, and will be unable to answer the first 
sub-jquestion. h ' 

We are similarly handicapped in our attempts to answer the ^ques- 
tion about transition to four-year colleges. No data are collected on 
EOPS or non-EOPS student post-community college activities. This is 
unfortunate because transition appears to be a very important issue. It 
"^9y be possible. to compare students' identification numbers from one 
year to the next and perhaps obtain a measure of transition rates to 
the university and st^ cdltege system. TKe critical question is 
whether procedures exist t6 f<S)llow individual students throughout their 
career in^the different California college^ystems. Even so, gathering 
the data will probably be difficult and time consu>ning. Barring this 
complicated, conceivably impossible cross-referencing process^ nothing 
in the existing data sheds- any light on thi6^issue tDf transition. To our 
knowledge tiSere is no regular, annual con^prehensiVe information of this 
type on non-!EOPS students, either." ' . 

A.S an additional note, we should mention one further analytic task 
that^will be possible in the future--year to year comparisons and review 
pf historical trends. USRS will be a vajuable sduVce ^of year-to-year 
comparative data. Any new elements that .are 'developed to supplement 




the evaluation system should- be responsive to . this ability to make 
comparisons over time. 

In summary we found that many of the questions that would be 
important In an evaluation system for the .HOPS program cannot be 
answered -»with the existing data sources* Reviewing the six broad 
evaluation questions in light of Table III, we found that the questions 
regarding background characteristics, service levels and student aca- 
demic success can be answered to a certain extent with the existing 
data sources. On the other hand, the questions relating to program 
charadte.ristics, resources and expenditures, and student success after 
EOPS cannot. Similarly, some of the comparisons between EOPS stu- 
dents and non-EOPS students can be made, but not all. In the next 
section we will consider ^both scaling down the questions of intei^est 
regarding EOPS and developing procedures for adding critical items to 
the data base. 

Before we turn our attention to proposals for developing an evalu- 
atiorv^ system based on this . analysis of current needs and information 
sources, it is interesting to examine the data currently collected which 
3oes^ not appear to have any relevance to evaluation of the EOPS pro- 
gram. In Table IV wrf have collected a list of some -"of the extraneous 

^ ^ ' ' ft ^ " ; 

information which is now collected on EOPS programs and students. 

These dataware not useful ^'n th^ir "current form for answering any 
of the question^ po^ed about EOPS by the meifibers of either study 
group. For ^example, the elaborate statements of needs,' component 
goals afkJ descriptions of activities included in Form 10 are not usable 
fdr large sc^le analysis. They are too bulky, "cumbersome and jdio-. 
syncratic* ,The budget projections by object class tode and by program 




TABLE IV 

A Sample of Extraneous Information 
(Not Useful for Evaluation System in Present._Eorm) 



SOURCES 



Year-End 

USRS * Form 10 Forma A-1 Report 



Student Background Characteristics 

Citizenship ' x 
Veteran Aid Status x 



Academic Information 

Student Declared Major 
H.S. of Last Attendance 



EOPS Program Characteristics 



Component Goals • * x — ^ 

Activity Description ^ - x ^ * • 

How Accomplished ' ' / ' ^ ^ ' x 

Future Status ^ - , . • \ - " x 

EOPS Service Levels ^ ^ ' ^ 

Prbjected Budget by Object ' ^ ' ^ » 

Class Code by Activity •* ' * x . , 

Projected Budget by Object ' « 

Class Code Jyy^Component a- , x • 

Projected Personnel by Activity , x 
Projected Personnel by Component ^ ' x- 

Combined EOPS & Non-EOPS ' ^ ^ 

Counseling- Hours ^ x , • ^ " 

Combined EOPS & Non-EOPS. 

Tutoring Hours x 



r ^ 
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activity code are too detailed, and change too much when final allocations 
are actually qf^ade. Other information--such as cFtizenship, high school 
of last attendance, etc., is simply irrelevant. 

.Thi:^ is not to suggest that they are entnrely meaningless to other 
agencies and for other purposes, .^But, the paperwork burden th1at 

; 

many administrators complain about is real. If changes are to be mad# 
'in current data collection efforts, one would do well to try to achieve 
some balance--deleting unnecessary reporting requirements at the same 
time that new supplemental information requests are being added. 

With this novel recommendation in mind, we now turn our attention 
to tlje task of integrating existing information into a usable evajuatrorr 
system. * . 



Chapter V 

INSIGHTS FROM OTHER STUDIES 

1 • ■ 



Introduction .^^^ 

In the past few years a number of studies have been conductfed to 
examine different facets of the EOPS program and the community college 
system. Wh He -none of these had as it's direct focus the development of 
an evaluation systemjor EOPS, .much can be learned from the analyses.- 
In the following sections', we wHI discuss several of these studies, 
describing briefly their research focu^ and dra\ling what implications we 
,can for. a ^tatewide EOPS evaluation system. 

• srtatewide .LonJ^itudinal Study Of Community CoUege- Students 
^ ' Descrmg^ . M. Steven Sheldon and Russell Hunter of Los Angeles 
Pierce College conducted ^a three year longitudinal study on commmunity 
college students in the state of California beginning with academic year 
^978-79. A fifteen campus sample of students who entered the com- 
munity college system that year served as the basis of their research. 

'Using telephone interviews and review of transcripts they followed 
th#e students for three years in an effort to obtain a more accurate 
description of the type - of students who ^enrolled ii^ the^ community 
colleges artd the ' various ways that they progressed through the 
system. Data were collected on a number of potentially relevant 
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< 



1 - ' 
The study had six specific goals, ^ which will not be recounted 
here. The interested reader is referred to the reportsa^emselves and 
to an excelleht analysis of \he utility of the studies for assessing the 
impact of EOPS written by Jennifer Franz (r981). ' 
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variables including the vocational status of the students, the changing 
natures of the students' academic goals, their reasons for leavii(g *the 
community college system,, etc. . . , < 

To this date three annual reports havjp beeVi published and a 
fourth is n^aring completion. These reports paint ^n interesting and* 
detailed picture of certain aspects of the community college student 
population in California. . . , <^ /' * 

Information About EOPg Students and Programs . Unfortunately 
the analyses have limited direct bearing on HOPS programs --in targe| 
part due to the strong underr^presentatio^ of HOPS' students in ,the 
survey sample. This may be'accpuntect for in part by the fact that the 
data collection was done primarily^ by telephone interviews. In Part I of 
the report SKeldon and Hunter explain that, "There was a great deal of 
difficulty on campuses with a hig^ , percentage of lower socio-economic 
level students, . .with respect to clisconnected telephon^s, wrong phone 
numbers, 'and moving with no forwarding address.'* 

In addition^ HOPS'* status wa? not determined directly. 'Financially 
disadvantaged' and 'educationally disadvantaged' were the categories 
used in the study, anjd these cannot be taken as perfeq^ surrogate 
measures for HOPS participation/ Franz (l98l) in her analysis of the 
report is quite specific on tHii^s point, and adds an addffional significant 
criticism: 

Thorough and consistent interviwer training is the sine qua 
nbn of valid telephohe survey research, and there is n6 evidence 
that the traininjg done for this -study, was' either. « 

. . * ...In sijm, the training and utilization of interviewers would 
appear to b6 a majo'r weakness of this study. One would n«ed 
access to the original data to prove that it affected the results, 
but it would be noteworthy if it did not. (p. 10-11) 
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As a consequence df all these problems, tti^ specific results of /he 

longitudinal study provide little informatfon about EOPS students. 

Relevance to an EOPS Evaluatioh System . Despite \he criticisms of 

the Statewide Longitudinal study, a number of general findings are 

relevant to the envelopment of an evaluation 'system for EOP^. One of 

the strongest findings of the study is that our old fashioned stereo- 

* • 

types of the typical community^ college studerat are not vali'd. As 
Sheldon and Hunter note in Part IL 



"The underlying assumption is that the stCident body ^is 
homogeneous-describing one or two "t^pic^l" students will be 
enpugh^^T^^^vide an understanding of alf $tad#nts enrolled in the 
<^o\\^Qgg^gfff(s assumption is unwarranted... ^ 



. • Comnhunity college students - are. heterogeneous in • every 
r^spectf^, demographic, vocational and educational. To determine 
the natyre o^;these students and thus define the educational 
service that the community college provides/ if is necessary to 

^ devefop something other "than the usual ' student profile." (p. 
70-71) • V . 

■fhfese finding reffect yery closely many of the comments made by 

the colleges .study 'group. Member of this panel often reiterate the 

notion that the students being served by EOPS displayed a wide diver- 

sity of ir^terestS' and academic goals. They r^'ect^d the notions that 

orre could characterize colj^ge students in a simple manner and^ thl^ 

resultant impUcation that ope could base an assessment of pie success 

of the program on simple measures of course completion' and transfer to 

otheV institutions, Sheldor>^and HunteV's conclusion on this point is 

unequivocal: • ^ ^ 

"The data • collected the first year of the Statewide Longitudinal 
Study are certainly" sufficient to dispel the myth that: 

6 

s •I. California Community Colleges*are primarily two yeaV colleges. 
2. ' Mast 'students who matriculate < finish their lower division 
requirem^^gt^arrd transfer to university, as juniors. 



- 3. A large proportion of students erfroll in and complete a two 
' year vocational program.^ ^ • ^ 

The myth is difficult to -destroy because some^ of the studetj^ts do 
carry out the program listed^^^^above but, considering the hundreds 
anc^thousands of potential students, vyho are admitted to California 
Community Colleges for the first time each year^^-th^ stereotypical 
two-year program describes the activities of very few." 

\1V is to Hunter and Sheldon's credit that they have gone beyond 

merely destroying an old stereotype and have attempted to create a set 

of more accurate prototypic descriptions of community college student. 

They group these students prototypes into t^ree broad headings-- 

iransfer, vocatiocj^T and leisure time--but within these three byroad 

categories they have identified 17 distinct * student prototypes . These 

descriptive classifications range 'frpm th^ "fuUtime transfer" and the 

^ * ^ ' • ^^^^ 

"unmotivated transfer" to the "career pftDgram completer" and the 

"leisure skills student." 

Sheldon and Hunter believe they can classify students into proto- 
types with up to 85% accuracy teased on telephone ^-discussions about 
t^eir goals in the commutiity* college' and a review of tragscripts. This 
raises an exciting possibility for capturing some of the divjersity of 
EOPS students. more; detailed classification of stu^nf types, s.uch 
as *that 'suggested by Sheldon and Hunter's prototypes might yield. far 
more useful and approp'riate information on the success of. EOPS. 
Certainly it would allow a more accurate formulation of student goals 
than that afforded by item S11 of USRS. - This possibility will be 
discussed in greater depth in Chapter 6. 

the classification procedure employed in the' Statewide Longitudinal 
Study ^as .another broader implication about the mission of the com- 
munity colleges. In Part III the report we %find the following issue 
raised: * . ^ • 
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^ ' The importance of" the findings lies in their capacity of 
increased understanding of.the^ community college "mission . " Lt 
has become eyidant during the study that students fend to gene-' 
rate, their own goal^, enroll in and drop classes at will, glean f rom • 
courses !the information they want, and leave when their own 
^personal goals have been achieved or are not being met. This 
indicates that the missfon of the community colleges i^ determined 
to^ a far-^greater extent, by the students than by other groups, 
e.g. Boards^^f TrustfeefT^cademic Senate, College Administration. 
^Xp. 56) 

Jhis echoes many of the comments made by the colleges -study 
oup. They -conceive of ' the mission of the community college irCvery 
broad, terms, afid see EOPS fulfillir>g a wide variety of functions. Some 
^ Students are successful ^by their pwn measure when .they have learned 
eftcDgh to obtain the job promotion ^that they Itioped to achieve. They. 
(^""^"^Qay drop out 6f college 'without , completing a degree program of any 
sort; yet in their own-terms'" theV ^tenure has been a complete success. 
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'Other HOPS ."students have a^specific goal of t^ansfe^r^•ng f q ^a fiu'r year 
college and calfcletin^^ a Bachelors Degree. A -lengthier^ pe^riod of- 
academic , course* work^ resulting in > a' successful transfer to a four "year 
college may be the only outcome that one wS^^ accept, as. a successful 
realization of this particular goal.. What^^^^yaluation. system, is 
^ppted should resf^ond to t^ls wide diversity of "rnterests and purposes 
among' €OPS -students. ^ - 

Two other .useful points fen\T)e g'le^ned from .thf analyses, theiu- 
setve^! ' The first^ contradicts a traditional^ass^mptiori "that vocational 
and non-vocational students have markedly* d'ifferent academic 'goals. 
.The §econd* points out the poor validity of mea^res of student goals-- 
in particular measures related to desire to transfer to a .four year 
college. ' ' « / ^ • 

One finding of the Statewide Longitudinal Study' illustrates the 

• - * * - > 

" difficulty 'of using the traditional student goal laf^els of vocational ^nd 
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non-vocational. Overall 30% of the. respondents in the study indicated 
that they wanted to transfer to a four year college", while 36% said that 
they were 'attending school for job related reason's. (General interest 
accounted for 20% of the student?, AA degree for 6%, and home or 
hobby skills for the remaining 2%. ) The stereotypic view of the com- 
munity colleges would place the vocational students among tbe '3B% v^o 
ar^ -attending for job . related reasons, whHe non-vocational students 
would form the bulk of the 30% who are planning to transfer to four 
year colleges.^ 

The results of their study indicate that this view is completely 
erroneous. Vocational and non-vo(!ational students were almost equally 
distributed among the 'categories. 25% of the ^vocational student said 
that they planned to transfer to 4 year colleges.' In fact/, most voca- 
tional programs in the community college system are"" set up so that the 
course work is'^rectly transferable to UC and CSUC campuses. ' Equally 
surprisingly, 28% of the non-vocational studen,ts indicat^jfd that they 
were attendirv^ the community college for job related reasons. 

The authors of the report suggest, that misclassification of respon- 
dents according to the ^SAM criteria msfV responsible for some of 

J' 

th^se data,' but this would represent only a small percentage., The 

conclusion we- draw from these data is that one must be' extremely 

careful when categoVizing community college students. By conjuring up 

incorrect stereotypes, descriptive labels may.obscue rather than illumi- 

nate'the nature of students* interests in attending community colleges. 
♦ * 

After' studying . the individual student^s transcript and having a 
lengthy *telephone^ conv/ersation, the interviewers were - asked to inter- 
pret the student'iS ability to \rticulate his specific gbaT.'* The results on 
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; ^ • * . . . • 

th-e question GOAL CLARITY are interesting. Overall only 51% of the. 

< 

respondents were judged to have articulated specific goals. The other 
half of the sample had a genefral idea of what they were interested in 
(-37%) dr had no clear idea a/ all (12%).'" This suggests that the com- 
munity college cduld provide an opportunity -for students to clarify their 
own specific* educational and career goals. .As Hunter and .Sheldon 
concluide, "this findmg .points, out the need for more and better career 
counseling on community cpllege campuses in California'? fp. 37) 

Review of repons.es from - other questions further illustrates the 
uncertainty of student goals. When students were asked, ".Do* you plan 
to attend a four year college?" The responsfe differed markedly from 
those reported in the previous disc^sion, ^53%, of all students 'said 
."yes" (up from the 30% reported above). 'Sheld(^^ and Hunter's ^xpla- 
-nation of this • change was- that students responded to. this^^'question in 
terms of' "long term aspirations," .while the figures above represent 
more reliable,, short-term predictions.. (As^will^be reported' BeJow, the* 

ETI study found an even higher ^percentage of students who aspired to 

.J. * 

attend a four yfear college.) The conclusion we draw f ronrVf all of this 
research is that student goals are a very tenuous .measure 'and must be 

= ' • , f 

used with grea> care.^ 

^ Conclusion . The Statewide Longitudinal Study suggests a number' 
of issues .that are ^relevant to aQ evaiaation system- for EOPS. fl 
reinforces the notion ^^j^^ the community colleges have a diverse .and 

'copiplex - mission. \ EOI^S students comprise a wide variety' of student 
prototypes, and each* may have different set df ^goals. Under" ^uck 
conditions it would be difficulty to 'measure "the succes^ of an EbPS 

program. . > 
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Atte'ntior> must be paud to the cbrfcern^f «a^e. colTeQes study group 
that EOPS provides a nunjiber o^ services to students: counseling, 
icial aid, whi/ch in and of themselves may' go, a long way 
ig»' student needs regardle§% of their -particular educafior^al 
goals. The Sheldon-Hunter study also reminds us that transfer tp a 
^our year college is a commonly held goal among community college 
students. The legislative executive study group's interest -in transfer 
rates is legitimate. A number of thle^ EOPS students have as their 
immediate or their long term ^aspirations transfer to a four, year college, 
^nd no evaluation system w6uld be complete without at lea^t considering 
these statistics. ' . ' ' 



W^at Happened to the EOPS Students of Fall 197S ? • ( A pilot follow-up 
study comparing EOPS and^^ll other- first-time entferinq Fall, 1973 daV 
Students at .San Jose City College ) . ^ . ^ ' ^ 

Descriptjon .. In June, 1979 Paul Prl^ipg of San Jose City College 
completed a study on ^PS students vyho enured the college for the 
first tipfie in^ the Fall of 1973. The study had ^two pur poshes: ftrst, to 



1 



develop a model which might be used by other compiuhrty colleges to 
follow up the performapcer oT EOPS students over time; and second, to 
compare .academic performances Jatid the general i:ollege population at 
San^Jose^ City ^°'!^^^'^^ particufar, he was interested in looking, at 
students' degree' objecti\pl, their success in meeting th^se, objectives, 
^amount of academic work ^they^ completed, grade point averages, * and' 
number who actually .transferred to four year colleges. Ta' some, extent 
he achieved both of hi^'goala, but the difficulties he encountered p^oint 
up t^VB fact- that there are n6 easy Ways to obtain lon^Itgdinaf data on 

. ' . • . • •• > • ; \ - ■ 

stuslents. ' ' - . ' % , \ • 
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The study was conducted through examination of transcripts and 

other records 'in the San Jose Community College Admissions Offjce. 

The study team went back six years and obtained a list of all ffr'st time 

students wffo obtained EOPS grants, funds, for tutoring, , or funds for 

•work study in Fall of 1973. The analysis' was based, on . the official 

records of these students over the ensuing six .years. Each student's 
^ f . 

record could have contained over 30 different types of information, it's 
interesting to note that of the 49 student records that were used in the 
Study, only 29 were relatively complete on all these categories. How- 
ever, as Preising points out,, '^all of. the students' grade records with 

relevant data, were complete. Thus thre questions pos^d for this study 

* • * *^ 

d'buld:be answered" (p, 7).^' * - , ^ , 

( ' • * 

Results. .' •TTie bulk ^f, the report examines five comparisons 

i' 

between EOPS and nonrEOPS students. (The data on non-EOPS stu- 
cjents were t^ken from an earlier study. What Happened to the' Class of 
Fall 1973 ?, conducted at San Jose City College.) The study finds that 
upon enrollment, EOPS students had^lower expectatons than non-EOPS 
students, yet they received a higher (percentage of AA degreees, j|ad a, 
higher .retention rate, completed more units, had hngher CPA's, ^ and a 
higher percentage enrolled fn four year ."colleges after leaving :^he com- 



munity colfege. Preising attributes these rather startling findings to 

by 



the additional attentiorj, support, .and academic ^a§si^tance provrded^by 



the EOPS pQogram. ' ' . ' ' 

' Fc^llowrup Telephone lntei»views . In a subsequent effort, Preisjng 
attempted to ^co.ntact 49 students by telephc^ne an>d conduct folloW-up 
intervi^s*' He bas.ed his. interview format on the interview, guide used>^ 
Jn the Statewide Longitudinaf Study, l^^^|j|.c6llege's' records incTuded 
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telephone 'numbers *lor all of the students; however, they proved to be 

extremely unreliable.^ Th^ study team was able to contact only 7 of the 

49 HOPS students who had enpolled for the fir$t time in 1973. In 

addition, it was able to get information on 5 others from family members 

who answered the telephone' calls. Because' the sanjple vvas^.so small, 

they reported only anecdotal evidence from these telephone contacts^ahd 

did not Attempt to draw any 'broader conclusions. ^ 

Implications for an EOPS Evaluation Sy'stem . This study suggests 

that HOPS programs have a lot to offer, and that EOPS students may in 

fact be ^receiving tremendous benefits from the additional "assistance 

fhey are given In th^i^regard it reinforces the importance of , develop- 

ing* a relial^Te evaluation system for the EOPS program.' In reinforces 

the notion that , a longitudinal study is necessaT*v^"ta~really understand 

the long term benefits of EOPS*, while at the same time ^adding ^idence 

to the argument that such studies^are not easily accomplished. Reexam- 

ination of past records is ^ time consuming and not easily undertaken on 

a lai*ge 5cale. ^ * • 

StuderttS' are a parti,cularly ipobrie group, especially after they 
ft 

feave college. Thus the low /response rate to the followrup telephone 

. V • ' 

interviews is not surprising. Sheldon and Hunter had much greater 

success by begmning their, contacts with students while they were still 
, * > * 

enrolled 5n ?choor and then continuing, the follow-up contacts in' subse- 



'"^queq^r y< 



years, Preising makes 'a similar recommendation for others who 

'* ' - ' ; ^ > . • '* ' " 

consider doins longitudinal follpw-up on ' corrtmunity college students. 

* / > " y " ' . . 

To'get a -high rM^.of response from forrper EOPS students . will 
r^qUrre keeping, contact yyijth af least a sample of^students as they 
^. progress through^* col leg"e. If studfents^ understand the 'impcvtance 
of> follbw-up and7 vyhile Lti coHegd fciave been advised that such 
follow-up .wilk/bB made, ^ their * cooperation should facilitate high 
response rat^ and reasonably- good ^data. (p. 34) 



There's one additional point to be' drawn from the Preising study 
regarding an HOPS evaluation System, this relates to the number of 
EOPS students who transferred to four ^year colleges. In What 



Happyi^d to the EOPS Students of Fail 1^3 ? transfer rates are inferred 
from the students' requests that tr^anscri^ts be sent to a /:ollege. This 
is a necessary but hardly sufficient condition for transferring to a four 
year school. It i^ a clever method of obtaining an indirect indication of 

/ a student's 'emcollment m a four year school, but it is hardly reliable. 
Onp of the questions 'that must be addressed in ^n evaluation system is 
how to obtaifj a better, more accurate appraisal of transfer rates-. 

Conclusions , Tthis study was an ,excellent attempt to document 
ipr^cisely wh-at happened t^'a group of EOPS students over time, and 
we applaud^ its intention ^as well as the efficient Ind ipsightfuh methods 
that were used. Two points ^ emerge strongly. First, longitudinal data^ 
must* be built into oi^oing evaluation systems if it 4s to be obtained 
reliably. S^coQd, ^ore direct and accurate, measure of transfer 
status is necessary. If an ^evaluation system can incorporate both of 
these aspects the^n the' kinds ^-of striking EOPS successes) reported ^by 
Preisjhg at San Jose City College may -be documentable ' on ' EOfJS 
stijdents statewide. T" ' - '^«5f«* 

College Going Rates In California (Knoell Repot^'t^ ' ^ 

Description . Since 1977. the Califon^a Post-Secondary Education 
Commission has published anSannual report on th^ college going rates of 

"^Callforni^ h\gh, school graduated. The main focus of 'the report has 
been the three segments of the California public colle^ and ui^uv^sities* 
systems--the "University of California, California State Universfty ^d 
.College system, and •the California Cgmm^unity ^Cqllegfes.' fru'addition. 



rate's for accredited independent colleges and universitiiss in the state 
of California have - been obtained yearly since 1977. Data for the 
various tables and graphs in the report is ^obtained from -the colleges 
admission's offices rather than from student quqi^tionnaires. As a 
result, it provides a very, accurate indication of precisely which 
students were admitted and began attending the various post secondary 
educational institutions. * 

The analysis havts gro>vn more detailed ^ach. year. Initially rates 
were .reported separately for, men and women. Beginning in 1979 they 
have also' been broken down by ethnicity. In the last two years, ^ 
transf^ rates for students who leave the community -cpl lege system and 
enter .the University dr the state university and college system have 
become* available as wetl. These are also Iproken doWn by gender art^d 
ethnicity, founty by county aggregations are made as welj as ov.era^ 
statewide totals. 

Results . The commission's report contains a {lumber of interesting 
figures and tables describing the various classifications of first tirtie 
college freshmen and high school se.niors in California^. One table of 
particular interest ^, for EOPS*relat^^ to jlfie ethpic- distribution of 1979 
graduates and first time freshmen in California. • T^e most striking 
difference is the increasing number 'of minority students whrf are 
admitted as one move^from the University, of California to the California 
State 'University and College System and finally to the California^Com-^ 
munlty Colleges System. For example, 3.3^ of the men and 5.4% of the 
women adfT)itted to the University of. California in 1979 were Black. . Jfhe 
same figures for the* California State University and College System are 
6.8%' and 10.4% respectively, while at the California Community College 

SO.-- • 
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System 10,5% of the men and 10,8% of the women who were' admitted for 
the first time in ISjg' were Black. The reverse jDattern holds if one 
examines the percentages of the various freshmen, classes that were 
White. At the University * of Californfa roughly "74% of the freshmen 
.were White^ while in the California State University and College System 
the percentage dropped to roughly 69% and in the Community College 
\^ System to a similar 69%. The pattern for Hispanic and^Xnericgp Indian 
freshmen follbws almost ej^actly the ratios 'displayed among Black fresh- 
men. (One must -use the figures from the California , State University 
and College System* with some caijtion, however, because fully 30% of 
the* ethnic data from this source yvas missing. No explanation of thi^ 
large amount of missing clata is provided in th^summary report.. 
^However, the missing^data is not a problem* with the Univers^y of* 
California or the CaliforKia Community Colleges.) 

^ . In 1979, the report, also included valuable information about stu- 
' dents who transfer from the community .colleges to either the University 
of California or the California State- University and College System. In 
f^t, Knoel^ presrents ?^e 15 year trend in Community College transfer 
students compared with total nimjfcier of first time freshmen." Since 1975 
the. number ^oY commtSriity college- students transferring to U<».C. has 
declined from abodt 8,000 tq 5,6^0, During" the same period the number 
transferring to CSUC declined from about^35/000 to ^0,000, During 
this period 'the entering ^/reshmen class.es at UC and CSUC ren/ained 
about tfrer sajpe size overalH*^ Thus the transfers for the last^fivp years 
, have represented an . ever slightly decreasing ^percentage of new 
admissions for the two post-sfecondary institutfbns.- 
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Also of interest is a breakdown of the 1979 transfers by* ethnicity. 

' 1 ' 

While Black students represent 12.2% of the full time community colle^ 
enrollment they represent only 3.3% of those who transferred to the 
University and 6.8% oK those who transferred to the State University 
and Colleges. Similarly, Hispanic "students are 12.1% of the overall 
community .college enrollrpent but only 7.5% and 9.7% of those students 
who transfer to UC and CSUC respectively. It" is only among Asians 
and Whites that this pattern is reversed. Thus is appears that while, 
the community colleges are serving proportionately larger percentage of 
the minority students, these students are not using the community 
colleges systems as a stepping stone to another post-secondary 

. ' \ . - - 

institution. / 

There are many ways to interpret these numbers. Wit4iout further 
longitudinal study of students at the community colleges, it is difficM,lt 
if not impossible to know what^these disparities in transfer rates 
represent. 

vUnplications for an Evaluation Systern of EOPsC vThe data in the 
Knoall report provide valuable baseline information on what is happening 
overall to the student population in the various California post-secondary 
instiifeutions. Transfer rates .by gender *and ethnicity are, in fact, 
available for each individual community coHege as well as the county 
and state wide totals referred to above. Howeyer, while these data 
help describe what has taken place at a statis^cal level, ^they do 
very little to answ^ the question of what the trends represent in taj^ms 
of pr^ograms. In many respects, ^e data ask^more questions that they 
answer*!. Because there is no indentification ofjjstudent goals nor of the 
particular program that a student -was enrolled in, it is difficult to make 
any but the most general interpretations. 

• • • 9S s 
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At present, there is' no coding to identify a student as a partici- 

^ 'pant in EOPS, 1t is not required as part of most college application 

pirocesses and it i3 not one of the mandatory pieces of information that 

is * reported ^ to tbe C^liforriia post-secondary education commission. 

.However, this situation may' be. changing within the next -two years. 

Our cohversaton with individuals at^ CPEC indicates that they are'verv 

' . . ' / 
^ interested in obtaining an HOPS identifier op newly admitted college 

transfer .Students in -the near future,. They hope to expand their 

, turrent data ba§e in m^y ways, and the HOPS ident'ifer is^^high'on the 

list opadditional idata 'th^y vyould like to collect. * This addition would 

provide tbe most adciirvate indication of HOPS transfer rates . available 

* . , f *• ^ * , ' * 
r^"'-— from any sourcp.. - - — - . • ^ ^ 

' The data bank from which college going rat&s in California is 
, . , compiled is available to qualified users. Thus, it would be possible to 
access this:i|hi^qhly refeyant^^nd accurate data source in an EOPS .evalu> 
ation system. There is one drawback hovyever: it takes CPEC, quite 
some time to xqljecf, vemfy/ and clean ;the data_^ Colleges are asked to 
provide information by January 1st on the class that entered Mhe 
\ previous fall. It take^^some time for this data to, be screened and 
verified*. In fact, two' years ago the final data tapes were not av^ilabl^ 
until Sept^ber of the following year, and for the ^cUrrerat ye^* (1980-* 
^ 81) they were not availably until 'this summer. Thus, Jor .example, a, 

§tudent Who completed an ^EQPS^ program in June^and transfeVred to the 
California' State University and- -College System in the fall Would hot. 
show up in the CPEC data base as a verified 'transfer* student until the 
following summer. • i 
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While it may be two or three years before EOPS identifiers are 
adopted by C PEC and yvhile there is an inconvenient^ time la^ involved 

in obtaining accurate data on community college transfer rates, the 

' ' ' V ' , . ' \ 

^,CPEC -data base from which the Kn^elTceporf^wa^N^^ived appears to be 

^a, very promising source of information in a future EOPS evaluation 

system. . - , ' , ' * 

Xhe .Study of Extended Opportunity Programs c^nd Services ^In 

. Califoriiia' Community Colleges * * *• * ' 

Description ^ - In^'^IS^S, the Evaluatipn and Training Institute 

conducted a study desigrfed to provide the first '^external'* audit, or 

evaluation, of EOPS_m its_ s tatewi cje system of community colleges.^ 

James W. Trent of UCLA was director, and Ronald W. Farland, 'then a 

full-time professional associate of ETI, was associate director. EEA has 

/ 

commistioned Trent to write a brief summary of that study And consicfer 
its implications for an ongoing evaluatic5n .oT EOPS^. (See Appendix BO 
Information *about EOffS . The data base for the^^ev^luation was 
comprehensive, including the 'following: (1) extensive, carefully pre- 
tested surveys of statistically representative (mostly random) sampling 
of all constituent groups in the 93 participating' colleges--EOPS 
students, "non-EOPS students (for comparative,\ "control" purposes), 
faculty,"* administrators an^ ^chairs of advisory committees; (2) institu- 
tional and program characteristics obtained from a "Ba^ic Data Sheet" 
designed by the Project staff and reports submitted by the colleges to 
the Chancellor's Office; and (3) case studies based on ' thorough, 
. accreditation-type site visits 5f 12 colleges, representing the spectrum 
of California's community colleges/ 
* * 

• ■ - ■ . 94 
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Several important strategies wer^ executed which helped to assure 
that the data, base described aboVe yvas a^ch one: The college presi- 
dents appointed their own college liaison officers to 'assist the Project 
Staff; a series of Vegion^f . vvprkshops were held for the Project staff; 

Hasdn officers met P^ularly with the statewide EOPS Advisory Commit"- 

. " f 

tee; and pre-site visits were made and site-team orientations were held 

• i ' . 

to assure that all elemenvf^of the case , studies would run smoothly 
These strategies -without question contributed to remarkable results'^ 
The survey response rates ranged from 7C)% of the EOPS students to 94^, 
of the EOPS directors. Almost all of , the ' data .sheets--.and other docu- 
ments requested - were- received. The site \;isits went even better than 
planned. On the other hand, the project was consfrairffed ^by typical 
limitations of -time and fiscal resources. ' 

Relevance for an' EOPS Evaluation System . The study suggest^ a 
number of, points concerning procedures, criteria' and. issues ■ t'hcg: rhay 
well deserve consid,eration :in*fu,ture evaluations of EOPS.' " A cbmmenT 
on several major points follows. ^ Trent notes in ' the Appendix ihaT 
among the procedural , points , most commonly mentioned ;was the lac4^,-of 
key definitions, especially operationaP d^finitions-^^g^ eligrbililty .tb 



EOPS'-that 'would contribute to^data validity... A series of multi varjate ' 
analyses in"* the study clarified tha'f ihere is no one measure ot 
^•success" of EOPS. Instead, ^here a>e a variety^of criteria deserving 
consideration.- Vhis has also been noted in t^hs EEA study and is 
reflected in the user^'^roup questions which have been posed/ ✓ 

Trent notes that a number of other points to be derived from the 
study pertain to the role of the^Chancellpr'^s- Office in the evaluation of 
EOPS. These include: • (1) the need for greater, more 'informative/. 
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more prompt and more res'ponsive consulting; (2) thie rtled for mucl^ 
more prompt and meaningful feedback of collective and comparative 
information; (3) a ^defi^itfe reduction in and justified rationale for the 
data reports required of thg colleges; and '^(4) greater statewid coordi- 
nation of all these efforts. . Certainly, these/points must be attended to 

jn the evaluatioia system that we will devise X/ , ' ^ 

- . «^ • ^ 

Three -concluding points are noted 45y Tr^nt as emerging from the' <« 

. ^ ^ . rv^ / _ 

evaluation. F^irst, ongoing evaluations shdofd reflect appreciation, for 

the diversfe ways and settings- -and the quality of their diversity-- 
through which Calif6rnia's community colleges carry* out their program^^^^ 
and overall missions. S^cond,w evaluations of the kind under considera- 
tion should include a systematic assessment ^of the larger organizational 

c 

and community environments ip which. the evaluated programs operate. ^ 
A third point noted--m6re difficult/^ and perhaps' not relevant to our 
v\i:ork--that legislation , for such, programs ^as HOPS must, itself, be 



co?^tinuou6ly evaluated for its appropriateness* in light of changing 



economic »and social con4itions. 



Chapter VI 

EOPS EVALUATION SYSTEM RECOMMENDATIONS: 
■ DATA COLLECTION 

Having surveyed the avajlable sources for evaluatior^ data and the 
expressed needs of var.ious evaluation users--and the coincidences and 
discrepencies between the two--we now describe data collection forWie 
proposed evaluation system. The proposal derives from all of the 
sources we have surveyed (Chapters ll-V),.as well as from valuable 
conversations with people ih the Chancellor's Office, .in" the California 
Post-Secondary Education Commission, at individual community colleges, 
and with sother; evaluators. > ' 

The /proposed evaluation system utilizes many of the existing data. 
souroes-"some with moplifications-'^^nd includes twb-^ new surveys of 
students. These data bases are summarized jn Table. V a'nd the corre- 
spondence to the six evaluation questions is shown. ^ 

Information for question 1 is generally available from various of, 
the USRS segments', along with some recommended additions to USRS- 
EOPS. . Similarly in question la , most of the relevant information is 
already prqvided by USRS; yve recommend that certain supplemental 
data be made-available by expanding USRS to include the collection of 
annual data on a[l students. 

Questfon 2 wilTbe based o.n information from Form 10 and suppl^- 
\ental ^ta from the recommended expansjon of the Operatiohal Program 
Review. Comparison of EOf^S s^v\ces with those offered iri^the total 
college ( question 2a ) has been dropped because appropriate data cannot ' 
be made available in. a feasibly manner at this time. However, we feel 



TA3LE V 

* THE EOPS EyALUA-n0fj SYSTEM 

PROPOSED AND CURRENTLY/^AI.LABLE. INFORMATION 



QUESTIONS 



RELEVANT" INFORMATfON 



AVAILABLE AND USEABLE ' PROPOSED. ADDITIONS/REVISIONS 



What are the background 
characteristics of the 
population served 
EOPS? 




Prior school ej)Cf>eriencef 
high schopi diplonr^/certificate 
high sghoDf GPA 
'Age 

;Ra^ 

tudent financial heed 



USRS-census & annual 

USRS-census & annuaf 
'USRS-census & ' annual 
USRS-(2ensus & annual 
USRS-EOPS 



USRS-EOPS 



la. Row do these compare A 
with non-EOPS- sjtud^rvts? 





Pric^r school e:><perience: 

high* school * diploma/certificate 
• fiigh school GPA 
Age ^ ^ , 
Sex 
Race - 



USRS-census 

r 

^USRS-census 
USRS-census 
USRS-census 



USRS-ahnual 



2. Whdft ar^the elements 
/Qf< the/fcOPiS Program? 



Community needs 
Activity Goals ^ 
Program subcomponents 
.Number and type of 

^activities offered . ' 
Organizational structure 



Form 10 
Form 10 
Form 10 

F6rm 10 
Form 10 



J: 



Operati6nal Program 
Review (OPR)' 



^a. How do these compare 
with- non-^ EOPS Students? 



DELETE : 
Judged Jto ^be beyond the limits 
of the evaluation system at 



• TABLE V (Continued) 



QUESTIONS 



3. What l^el of services 
are provided in EOPS 
programs? 



RELEVANT INFORMATION 



AVAILABLE AND USEABLE' PROPOSED ADDITIONS/REVISIONS 



Estimated number of gtudents 
/ ser'Tfed per component 
Actual n.umber of students 

served per component 
' InStructionarl support activities 
Tutorfng hours 
Courtseling hours » ,^ 
Administration activities 
Oth'^r activities 
Financial Aid to students ; 
Work-s'Ajdy grants to stubents 



Form '10/ 



Form 10 
U5RS-E0|5S 
USRS-EOPS . 
Form A-1^' 
Form 10 ^ 

Form A-1, USRS-EOPS 
USRS--*EOPS 



Form A-1 revised 



USRS-EOPS revised 
USRS-EOPS revised 



4. How are resources 
expended? ♦ 

« 



Expenditure .per component 

(100-906) 
Projected cost per component 

(iPO-900) 

^ Projected cost per activity 
(37» levels) ' 
Distrfct contribution. 



Form A-1 revised * ^ 



Form 10. 

Form 10 ^ 
Form A-1 



5. ^ How successful are EOPS 
y students during their 

tenure at the, community 
college? 
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What are students' own academic" 

goals? ■ _ * 

Hdw successful are they in 
terms of their own goals?- 
How successful are, they relative 
to: ' ' _ ' 

units attempted * 

units completed^ ' 

weekly " student contact hours USRS-census Sjr annual 
positive attendance enrollment ' USRS-census & annua' 



US'RS-census & annuaf 
US^S-EOPS 



^Supplemental Survey' 

Supplemental SurveV/ 
Lon^itudmal Study 



USRS-EOPS revised 



ERJC 
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TABLE V (Continued) 



• QUESTIONS . 



RELEVANT INFORMATION 



AVAILABLE, AND USEABLE '. PROPOSED ADDITIONS/REVISIONS 



5, .(Continued) 



stucfent level 

academic standing beginning 
of term" 

academic standing end of term 
annual GPA /' 
cumulative GPA ^ 
drop-out/retention rate 
AA'.or As certificate attained 



USRS-census & annual 

USRS-EOPS 

USRS-EOPS ■ 
USRS-EOPS 
IfSRS-EOPS ' 



USRS-EOPS revised 



USRS-EOPS revised 
USRS-EOPS revised/ 
Longiti^dinal Study 



5a. How do these , compare 
with non-EOPS 
students? 



Now successfyl ^rk they 
relative to: ^ / ' ' 

units attempted'" . 

uriits completed 

.wee'klV student contact hoUr^. 
positive attendance enrollment 
student lev/el 

academic standing beginning 

of term / 
academic Standing end of term 
annual GPA * 
cumulative' GPA 
dtdp-outi/reteht?on rate 
AA or AS certificate attained ' 



USRS-census 

USRS-census 
USRS-'cerisus 
USRS-census 



USRS-annual 
USRS-annua! 
USRS-annual 
US^S-anhual 
USRS-annual 

•USRS-annual 

USRS-annual 
USRS-annual 
USRS-annual 
USRS^nnual 
USRS-annual 



TABLE V (Corrtinued) 



QUESTIONS 



^ RELEVANT INrpRMATION ^ , AVAILABLE AND USEABLE^ PROPOSED ADDITIONS/REVISIONS 



How sihccessful .are EOPS 
students when they leave 
the community college? 



6a. How do these compare 
with non-EOPS 
students?' 



How successful are they in 
terms of, their own goals? 
How succe^ssful are they relative 
to: 

job placements J 
traas/er to four-year ' • 

Institutions ^ 
success after transfer 



How successful are they 
relative tct: 

' transfer to four-year 
institutions 
success after transfer 



CPEC^ 



Longitudinal Study » 



Lqngitudinal Study 

CPEC (if planned -revisions 

are made) 
CPEC (if planned revisions 
*• are rftaide)^ 



Currently available and useable with only minor modifications or imprxJvementV in -data access. 

We suggesft that a supplemental analysis ba conducted to determine .the correspondence between 
budget levels \jsed in progrm planning on Form" 10 and actual expenditures are reported on Foriji A-1 , 
Form 10 data may not be useable if this correspondence is low. 
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fhis is a potentially important question that might be addressed in some 
manner Ln the future.' ■ " ^ • . * 

Data for question 3 are (X^T^ntly available. fr6m USRS, Form 10 
and from FormA-l with some minor>ev*isions recolnmend^ for USRS^W 
make the information more meaningful. Question 4 will he answered at a 
fai'riy .broad level by elements gleaned from Fpr>TsA'-1 and Form 10. 
The academic success data for question 5 are available from USRS--and 
from a new Supplemental Survey of EOPS students f^used on students' 
own academic goals. To answer question 5a w'e are recommending that 
the USRS arfnual survey be expanded to include all students. Data-for 
6 may be avaMable- through the California Post-Secondaf-y 
Education Coifin^ssion (CPEC), "but .the evaluation system relies most 
heavily on newly proposed EQPS longitudinal studies. , ^ ■ • - 

For the remainder of the 'chapter, we will describe these modifica- 
tions 'in greater detail, considfering USRS, Form A-1, the CPEC data 
base, and OPR. . Addrtidnally, we will suggest adding4he Supplemental 
Survey and the Longitudinal Study of EOPS students to'the evaluation 
system... Finally., we. will describe a practical data collection timetable. 

Delineation of Data So urces: Additions, Deletions, Modifications ' 

.When we b^gan ouc investigation of the existing EOPS inforrtiation 
network, we reviewed each of the six data sot^rces for reliability, vaMd- 
tty/ and 'accessibility, and we asked how successfully they answered the 
.evaluation needs ^established by the-study groups. Two goals directed 
our work: to develop a^data collection system that produced information 
necessary for. answec-ing as many' evaluation questions as possible, and 
to do so frugally and- efficientlyV ^Thus, We have retained (with .some 



changes) five of the, origihal six data sources. In addition, we have 
added two new. instruments s^hich prdvide important unduplTcated injor- 
mation. These seven dat? sources-'-and the evaluation questions they 

--address— will be dfescribedHn-the next sections: ' • ■ » — 

■ .i*. ^ '- . 

USRS. Three distinct sub-s^^tems .of US.RS provide useful infor- 
matiQp for- us. / 

^^he/j'SRS census, data system Js completed once each 
tenw on alf * stiljdents enrolFed\in California community 
colleges. 

~r \ 

The USRS-EOPS student data 'survey is conducted once 
each year on EOPS students only. 

The USRS Annual student data segment ms administered 
annually on EOPS, handicapped, and vocational educatfon' 
students only. , , ' . 

The USRS-Census' gathers information about. each student's back- 

> 

ground characteristics, academic J6vel, and current course load. Of 
the 2(^ items, ^ 18 are required. (Because - expenence-H^r^edCt^^ 
response on optional items, we will not use tKem.) Of these 18, six §re 
useful in their present form as measures of background eharacteristics 
(questions 1 and la). Th^ree others provide information about a stu- 
dent's academic activities--but only very incomplete information. They 
measure course enrollment^ but not course completion^ 

Table VI lists all 20 DSRS-Census data items, notirfg which are 
required. The nine 'items we can use are cross-referenced to specific 
evaluation questions. * » . ' x ^ 

- The USRS-'EQPS attempts to .assess student status and EOPS pro- 
gram impact at the^end of the academic ^year, rather than to measure' 

on-going ""'sepvice levels. All 20 items of this assessment provide -$ome 
« 

information toward answering-'-the evaluation questions . ^To be sure, 



/ ^ ^ -'TABLf VI 
CENSUS STUDBNT DATA SYSTEM 



Data Element Name 



Elemeajt 
Number 



1 



Required 



Related Eva^uation 
Question' # 



College Code ' . • ^. 

Peport Period . 
Record Number ^ 
Birthdate . . ^ 

Sex , /*' . , 

Racial/JEthnic Code , 
Citizenship 
Resi/dence Code 

High School of Last Attendance 

College of 'Last Attendance 

High SchooL-Educatioh 

Enrollment status 

Student Level - 

Student Goal • . . 

Student M^jor 

Positive Attendance ^Enrollment 

Weekly Student Contact Hours (WSCH) 

Total Potential Hours of 
Atffendance (TPHAX 

Units Attempted \, • 

Veteran's Aid Status ? ^ 



V 



X.I . 

X2 . 

SI 

S10 

' s& 
s|.. 

S9 

S6- 

S3 . 

.S5 

S4' 

SI 2 * 

S11 

S13 

S?' 

SI?'. 



S15 
S16- 



■ X 
.X 
X 
X2 
X 
X 
X- 
X 
X 
X 
X 

x 

4 . 

X . 



X 
X 



/X. 



Q1 artd la 
Q1 aAd la 
Ql^and la 



Q1 and la 
Q1 afid la 
Q1 'aVid 



Q5 and 5a 

♦ • ^ 

Q5 and-5a 



Q5 an^ ^a 



^ . 

From *the.. Chancellor's Office Informatfoh System Data Element. Dictionary /^ May f981. 



'Required ohfy when submitting data^oa-SO-column card's, 



^ * * ^ * 

I - • • . 99" * 

•"some items produce rfedundant information an'd others require revision. 

, But on the whole,, the USRS-EOPS is very useful. 

\ ■ 

. . Five items measure the students' academic success (question 5). 
One^ item, which measures students' financial need for the term, is . . ' 
relevant" 'to assessing^background characteristics (question 1). Two 
other items measure levejs of academkL support services--counseling and 
tutoring (question 3); one item has to do with previous EOPS exper- 
ience'. Eleven items measure financial aid, dhstinguishing grants, 
scholarships^ *aids, and work-study. . For 'our purppse, * 11 separate 
figures are unnecessary. One grant total would do. * ' ♦ 

^ Table VII lists the ZO ' itOTs of USRS-EOPS and., again, cross- ^ 
references them to the evaluation questions. We also mark the items ' ^ 
that need addition or revisfon with an^ asterisk. (Table IX gives'- a* 
concis^ compilation of these additions and revisions. Appendix C pre- 
sents each reviseql item and the full text of each revised data element 
dictionary page.) ^ / , ' 

\ The USRS-anhual student d^ta segment consists of the same 20 
items as the USRS-Census, but .here 'annualized to provide, in the 
words of the iChancellor's Office, "demographic" and cumulative workload 



. measures to ^support the information in' . . . the EOPS student data 
system." This annjualization givers us a ^as^line against ' which the 
yearly 'USRS-EOPS*data can be interpreted. In addition to small modi- 

^fication.s in the USRS-annual* survey, w^ r^comr^ that a similar 
USRS-^survey be administered to aM students; without such an addition, 
it is not f^ossible to answer the two comparative, evaluation questions 
(questions la and 9a). - - . ' 
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TABLE Vn 
EOPS STUDENT DAf A SEGMENT 



Dat3 Element Name 



Eleijient 
1 

Number Required 



Related 
Evaluation 

Question # Revision 



EOPS Status 


E1(^ 


X 


05 








Academic Standing, Beginning 


El 


X 


and 


5a • 




Academic Standing, Ending 


E2 


X 


Q5 


and 


5a 


* ** 


Units Completed ^ , 


E20 


X 


05 


and 


5a 


* ** 
/ 


Total Financial Need \ 


E17 


X . 


Q1 








EOPS Grant 


E8 


X 


03 








B{EOG Eligibility Status 


■ ., E4 


X 


03 








BEGG Grant 


E3 


X 

7 


y Q.3 








SEiDG Grant 


E16 


X 


03 






♦ 


NDSL 


. E12 


X 


Q3 






* * 


COG ' ^ 


. E5' 


X 


Q3 






i 


Scholarship 


E15 


X 


Q3 






1 


Other Financial Aid 


E14 


X 


. 03 








EOPS State Funded Work Study 


* 












Money farned 


E9 / 


X 


- ' Q3 








Non-EOPS State Funded .Work Study 














Money Earned 


' E13 


• X 


Q3 








Total Work Study Hours Worked 


E18 


* 

X 


Q3 








GPA for Academic Year • 


Ell 


X 


Q5 


and 


Q5a 


** 


Cumulative GPA 




X 

* * 


Q5 


and 


Q5a 


** 


Tutorial Hqurs . ^ \ 


E19 


X 


Q3 






* 


Counseling Hours 


■E6 


-X r 


^ , Q3 






* 



^From the Chancellor's Office Information System Data Element Dictionary / May 1981. 

♦Revision recommended (see Table IX and Appendix B). 

**Addjtion of an .annual measure of this element on.aM students is recommended (see 
Table IX and Appendix B). ... 
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♦ ^ / 

In Table VIII we note the pertinent items of USR^-annuX c/oss- 
reference them to the evaluation questions, and -indicate whe^^ additions 
and revisions are recommended. 

The final HOPS Claim form, submitted It the end of' 

' / * 

the academic yeaV, presents a complete accounting /of all program 
expenditures reported by object class co'de. /Expenditures are classified 
in three categories: (a) program development %nci. maintenance; ' 
.(b) student services; (c) dire'ct payment ^o student/. THi's is minimally 
adequate information for our needs (qufestions 'I l/ and IV). However, 
we recomend that Form A-1 be modified to requi/e reporting by. compo- 
nent (100-900) rather thati just the tl/ree categ/ries. In particular this 
would provide both expenditure totafe and nOr/ber of students served in.^ 
the^nine different program ^^reas^d^^ignat^d on the original program 
application. ^ * , . ,^ 

In addition, we recommenc/ th'at/attiei)tion b& paid to replacing the ^ 
present, non-automatic analysis^ pvociAur& with* a' system for coding and 
analyzing Form A-1 data quickly in o/der. to avoid evaluation delays. 

CPEC Data Base . CP^C (the Cy&lifomia Post-Secondary Education 
Co/nmission) is responsiblef for collecting* and reporting data on students 
enf-olled in California colleges andAuniversities. A partial fist of the 
data elements currently/ m'aintained on Commission tapes is presented in ■ 
Appendix D. This data base contains one item potentially very impor- 
tant for HOPS evaluytion--t^ansfe^ rates djf community college students 
to four-year .institut/orj4 in .the /state (questions 6 and 6a). ^ 

Unfortunately,/cPEC currently lumps all transfer students Jtogether. 
Thus it 'is not now possible, to pompare EOPS transfer rates to overall 
rates. However, / among several proposed addi-tions to the CPEC data 

r 





TABLE VI II 








ANNUAL 


STUDENT DATA 
• 


SEGMENT 


• 










Related to 






Element 




Evaluation 




Data Element Name 


.Number 


Required 


Question # 


Revision 


/ 

Cpllege ^Code 


Xl 


X 






Report Period 


X3 


X 






Record Number 


X2 . 


X 


• 




Birthdate 




X2 


Q1 




Sex 


S10 


X 


' Q1 




Racial/Ethnic Code 


S8" 


X 


' Ql" 




Citizenship Code, Annual 


sA-r^ 


X ' 






Residence Code/ Annual 


\ ' SA6- 


^ X 


f 




High School of Last Attendance 


S6 








♦ 

College of Last Attendance 


\ . S3 








High School Education 


S5 


. X 


Ql ' 




High Schdol GPA (new item). 




- 


Ql and la 




Enrollment Status, Annual ^ 


SA4 


X 


Ql 




Student Level, Annual 


SA7 
■ S11 


X s 


Q5 and 5a 




Studentv-Goal 








Student Major 


S13 








Positive' Attendance Enrollment, 


Annual SA5 


• • X 


Q5 and 5a. 


** 


Annual Average Weekly Student 
Contact Hours 




y 


OS and Sa 




Actual, Hours of Attendance 


C A 1 
SA 1 


A 






Units Attempted, Annual 


SA8 


X 


. Q5 and 5a 




Veteran's Aid Status 

— * ■■ ' ' 


SI 6 


X ' . 




V 



.4-: 

''prom the Chancellor's Office In^f^rmation System Data Element DictipnarV y May^l98l 
*Reylsjon recommended (see Table IX and Apppndix ^^). 

♦ 

S **Addition of an annual measure of this element on aM students is recommended (see 
/' ' ,Table rx and Appendix B). ^ ' 
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/TABLE IX 








• ' PROP^OSED CHANGES 
REVISIONS, ADDITIONS 


TO USRS: 
& DELETIONS 




> 

USRS 
Segment ' ^° 


Title • ■ Item # 


r 

Change , 


Relevant to 
> Evaluation 
Question # 

r 



annual 
EOPS * 

EOPS, ' 

,^-^^Vs 

" EOPS 

} ^ ^ 

' ^annual 
annual 

' annual . 



annual 



annual 

annDal 

annual 
annual 
ahnuai 



high school GPA 
tutorial items 

counseling hours 

units completed 



academic standing 
at end' of term 

high school GPA 

units completed, 
annual 

weekly student 
contact hours 

positive attendance 
enrollment 

academic standing/ 
beginning 

academic standing, 
end 

annual GPA 
cumulative GPA 
student level 



add this item 

E19 ■ revise to separate EOPS^ 
and non-EOPS hours 

E6 revise to separate EOPS 
and non-EOPS hours 



E20 revise into same foj;mat 
as units attempted-- ^ 
item- SA8 



E2 revise to include AA/AS 
if no longer enrolled 



.E20 
(revised) 

SA2 • 



Q1 
Q3 

• Q3 . 

Q5 " 

Q5 

Qia/ 
Q5a 

.Q5a • 



SA5 



El 



expand the annual- survey 
to include all students ' Q5a 
(including these* items 
•as a minimum-' s^t) 

• Q5a 



E2 ' 
(revised)" ' ' 

Ell 

E7 

SA7 \ 



Q5a 

QSa- 

Q5a 

Qia 
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base is an HOPS identification element. We have been told in conver- 
satior* ^at this ,new item has high priority. Under the assumption that 
EOPS identifiers will be added to CPEC,' we are relying on this source 
as the primary basis for assessing transfer rates. In the event thac 
this change does not take place, it will be possible to •ob.tain similar 
information through the Longitu(;lingl Study, though this is^'a slower and 
more' limited proceduf'e. . ' ' 

Operational Program Revie^ . The OPR we foresee' will be a multi- 
pie day, on-site, team review of each EOPS program. The team(s)^ill 
review approximately 20-25% of the colleges each year on a , rotating 
basi-s. I he jDPR will address two evaluation concerns: compliance with 
existing regulation? and effectiveness of program activities. The narra- 
tive descriptions of pjanned program activities submitted as part of the 
program application (Form 10) wifl be useful ' in guiding parts of this 
review. This OPR ''program activities review will be directly responsive 
to question 2. In addition, vye would encourage expanding OPR's. scope 
to gain as much first-hand information ' as possible about how EOPS 
programs are berfig/ conducted and about the effectiveness of support 
services to EOPS students (question 2). To strengthen the overall 
review process, we would suggest that concurrent^nformal, open-ended 
.interviews witK EOPS 'students and staff be added. Potential jpfer- 
viewees in critjcal program areas and responsible student spokespersons 
might be identified by administering a brief questionnaire to all EOPS 
students and staff shortly before the OPR visit. In addition, these 
questiof^naire responses woul^ provide a rich source of qualitative data 
about the program. ^ 
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Finally, an overall aggregate report on all HOPS prcigrams reviewed 
during the year should supplement the individual school reports. 
^ Guided by question 2, Chancellor's Office staff or an external contractor 
could easily compile this summary analysis. 

EOPS Form 10. The Annual Progrlam Application (Form 10) will 
provide .much of the data relating to the elements of the BOPS f^J^ms 
(questions 2, 3, and 4). However, because ' Form 10 data re^lent 
projections rather than actual expenditures, they will' be useful only if 
there is a high correspondence between actu^ distribution of funds and 
projected budgets. During -ogr early analysis, we proceeded on the 
.assumption that there was a high correspondence. ^ 
At the same time, though, we tested that assumption. With the 
assistance of Jennifer Franz, we compared the projections of Form 10 to 
the annual expenditure reports of A-1 in a small sampling, of colleges 
for 1979-80. The discrepancies were so Marge in the sample'thatXhey"-' 
would render Form 10 useless for EOPS pr^ogram evaluation. (The full 
sub-^tudy analysis is presented in Appendix F). Beginning in 1980-81, 
however/ a new planning procedure was implemented and the current 
^program applications are 'based on reasonable'^ projections of actuaf 
^allocations. ^ - . 

These conflicting reports on Form 10 leave some doubt in our 
minds. .While we have included Form 10* as a part of our evaluation 
system, we suggest a sirnilar analysis be don# on the correspondence 
between Form Ip and Forni.A-l for the 1980-8.1 pchool year. ' 

The Supplemental Stjrvey of EOPS Students . We have designed 
the Supplemental Survey to provide new info,r|)ation about student goals 
and academicy plans (question 5). Based on the Statewide. Longitudinal 
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Study ^(of Chapter 5), our survey uses $heldon and Hunter's student 
prototypes. Students will classify themselves according to their acade- 
,mic goals. (A draft of the questionnaire will be found in Appendix E). 
This . brief survey, which will be administered each fall, will taKe only 

. 5 minutes to complete. • We suggest that a random sample of HOPS stu- 
dents at each college be selected to receive the Supplemental ^Survey, 
thUs reducing bother without reducing validity or generalizability . v 

, ' Lojigitudinal Study . We hi^e designed 1;he Longitudinal Study to 
collect* data on students* long-term activities which reflect their partici- 
pation in HOPS programs. We suggest a 10 or 15 campus sub-sample, 
selected from students who ar'e already participating in the. Supplemental 
Survey. 

^ *, ♦ ' 

students will participate in th*e study for four or five years. 
They will receive ^n annual questionnaire each spring designed to moni- 
tor their academic activities and assess owiy changes in their per>sonal 
and academic goal?. The questionnaire, •will incorporater a branching 
structure' based on student oMentation: , each goaJ category in the 
Supplemental Survey would have a unique set of follow-up questions 
relevant to it» ^ . ' - 

The Longitudinal Study wil( provide ihforjnation about how academic 
and career aspirations, change, what affects these decisions, and what 
happens to students after EOPS (whether they finish or drop out). It 
will also help to answer salient questions about the communfty cojieges* 
mission and how that mission' prescribes EOPS services. ' *. ' \ 
^ Because community college students are a highly mobile group, we » 
can safely predict that the Longitudinal Study poses the greatest ^iffi- 
culties (cf. the problems of Sheldon' and Hunter or Preising reported in. 



' . ^ . - • , 107 

'Chapter's)-. Therefore/ we suggest delaying the study' fat a year to ' 

allow more planning and .coordination with the HOPS offices "st the 

community colleges. It might be yvorthwhile "to. expand the survey we 

have suggested— the Statewide Longitudinal Study illustrates a number 

of additional issues that might be addressed 4* ' • : 

■ . ■•■"/. ... 

Reporting^-Scli'edule of EOPS Data Sources v , 

Figure 1 illustrates the data collection timetable^fqr ^he' seven 
; sources mr^e proposed EOPS evaluation system, Indicating, two critical 
-dates. The triangle denotes the' date of data collection; the circle 



• xienotes the dat^ on which analyzed data might be available for use^V 

" the evaluation system. The line between triangle and -circle repres^^^^ 
« the time required for coding and processing the data. 

jJSRS. USRS-EOPS and USRS-annUal data segments, which reflect * 
' information from the previous year; are collected in(the fall, and sub- 
mit«ed- to the 'chancellor's Office in October. 'Verification an<l confir- 
mation of the data require two to three months, and the ffnal totals ' 
.should, be available . in December. (Assuming, that the rfecommencJed 
changes in USRS-annual will be made, we have not included USRSp ' 
Census data in the timetable), v • ' T «• 

EOPS Form A-1 . -Expenditure totals for the academic year are 
rep.orted on EOPS Form A-1 and submitted 'to the Chancellor's Office 
soon ^fter the sprirtg term. These data are presently -analyzed by 
hand,, a process yvhich 'delays any. evaluation based on A-1 data ^jhtil 
the next fall. ^ ; * ^ . 

CPEC Data Base . The California Post-^ondary Education Com- 
mission* collects enrollment data from all three elements of the California 
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Figure 1 
Timeline foj^ D ata Collection 
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•O 



Supplemental Student 
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USRS-annual 
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CPEC 
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Longitudinal Study T ♦ . ' 
Part"! . . A \^ r. ' 
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college system--UC, C^UC, commi/nity A:olleges--during the winter for 
students who enrolled during the fall. Thus, all students who transfer 
from EOP^ to four-year schools, one year's fall data collection, will 
'show up in the CPEC" data base^as' new transfers" in the n^t year's 
winter reporting. Theoretically., the final data on these transfers are 
due at the CPEC office- ^y January 1. Practically, however, the last 
two year's deadlines .w^rejT^L^ Coupled with a . period of. up to 




eight months for putting data in an accurate form, this, suggests that 
one might not^be a^le to access information on a transfer student for a 
year or more after transfer.- . 

■ f • 

OPR. Since individual operational pro'gram review^ are scheduled 
for jJwo-day to four-day. periods throughout the Academic year, th^PR 
exit irtterviews and fihal report^^for individual schools will be available 
at ^various times from\)ctob6r to June. An overall summary, however*, 
could not 1^ compiled until summer and would, not be available unj:il late 
.summer.* a ' 

EOPS Form. 10 . Program applications are developed in the spring 
prior to the- new academic year.' Final Form 10s are not submitted until 
after the new state budget' is approved on July 1.' Thus, the program 
d^escriptive narratives -are available for use on a one-by-one basis by 
early fall, but the computer-analyzed fiscal section will not be available 
un^il later in^the fall. 

Supplemental Survey of^ EOPS Students . The Supplemental Survey 
questionnaire we .are recommencing will be administered to a sample of 
EOPS ^students in the fall only. The data will be transmitted to\he 
Chancellor's Office in October and available for evaluation system use 
aftpr a month, or two. 



Longitudinat Study . The Longitudinal Study we propose will 

require con^tact with students twiCB a, year--fall and sprlng--during 

< ■ # 

» their tenure at the community college, ^nd an' annual follow-up after 
^^^hey leave. Though the complete longitudinal analysis will take four, or 
five years and should be r^eported in five-year cycles, the question- 
naires wiil yield annual information as well, ^^fter the spring data 
^ collection is analyzed, a longitudinal /tudy report will l>e issued .each 

* summer. 

Ir 

, "Now, that the limits TtTiposed by the data collection timetable are 

* understood, we can turn to the evaluation reports themselves and the 



analyses th?t will^ inquired' to produce them. 
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Chapter VM . ^. ^ ' 
EOPS EVALUATION SYSTEM RetOMMENDATIONS: 

REPORTING & ANALYSIS ' ■ 

In this chapter we will recommend a multiple report evaluation', 
system for EOPS^ We will describe six evaluation reports: Whych.data 
sources inform therp, whicti evakiation need they respond to, how their 
^rtalyses are to proceedTand when^they should be avalfS^le- 

Multiple Report System ' ' \ ^ 

.Two major factors contribute to the practicality of a multiple report 
system.. -.First, the evaluation quesfipas analyzed sn Chapters jll and^^ 
ly. address EOPS on three levels: individual EOPS student, individual 
college EOPS .program, and EQPS systemwide. The natljral . division 
argues for separate, sm^ler documents. ^ ' ' 

Second, the evaluation data, operate, on different--and irreconcil- ' 
able-~timet§bles. It seems to ' us totally foolish to wait several rnonths 
for a complete report whten \useful data is rpady and waiting. Even 
though the fact that relevant data for any given academic year are 
currently collected over a two-year period dictates a twq-year evalu- 
ation period, we recorpmend makirl^ information in separate documents'" 
available as rapidly as pos^^^l^. , ; " * / 

The -six reports^yve suggest, are:^ * * 

the College Ctiaracteristics Report 



the OPR Report 
the Program Oriented Report 
• » • the Longitudinal Study- Report 

, ^ . - the Student Oriented Report, and' 

. V 
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Ii2 \ . • 

the Proflrajfti^tudent Interaction Report 
The reporting timetaoie is presented ins Figure 2. • ' - • 

f The^ College Characteristics Report . The Supplemental Survey of 
EOPS>,students will sprve as the basis for the College Characteristics 
• (CO) Report. In the survey, students classify themselves as one of^ 
seventeen prototypes according to academic and career goals (questlon| 
5). the' CC Report will then abstract a collective profile of the HOPS 
population ^t each community co\\w§^, which will prove, a valuable tool 
. for assessing the correspondence between the needs 6f HOPS students 
and the services provided by the various HOPS programs.- 

The collective profiles will be produced by tabulating the Supple- 
mental Surveys and presenting frequency counts, converted* to percen- 
tiles for easy comparison. Graphs representing the distribution of 
student types at each school and systemwic;le will make it possible to 
compare the profile of each campus to th^^overall profile of HOPS 
students. In^addition, schools will be clusterecj according to the' 
similarity of their student profiles. College membership in similar 
clusters will' be useful., in further analyses, particularly -tfl the Prografn 
Oriented Report and the Program Student Interaction Report. 

When the Supplemental Survey is collected in October, it will be 
sent fo the Chancellor's Office for analysis. The large number of * 
student questionnaires may slow down data analysis. In any circum- 
stances, the College Characteristics Report afhould be' drafted and XI 
edited by winter^ a February delivery date seems reasonable. 

: The OPR Report . OPR teams will provide individual school reports 
throughout the yeac |(cf. ^^apter VI). By .OPR Report, we refer to a 



summary of all the college reports wHtten during the year. The^ SPR 
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FIGURE 2 

Timeline of Proposed Evaluati.on Reports 
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report^ summarizes system-wide program characteristics and activities, 
foQi/sing on'' personal ^d organizational structures in thjs various EOPS 
.programs (question 2).r 

The first portions of the OPR, Report will focus on the severaJ 
sources of easily quantifiable data such as the parameters • documents 
which are checklists that indicate which services are incorporated into 
each EOPS program. However, we do not yiew this analysis as of most 
value: Instead, we would prefer to see the first part of the report 
focused more heavily on data which show the correspondence between 
actual program characteristics, activities, structures, etc., and those 
put forth in the Form 10 application. In l^feitiqn, descriptive statistics 
of systemwide program characteristics"^^^^l also be derived from Form .10, 

The second portion of this report is more difficult to produce. 
The data on which it will be based* include personal impressions, 
narrative descriptions and prose analyses which are more difficult to 
aggregate. The analyses of these will be guided by question 2. The 
analyses vyill be further guided by recurring observationAln the' 
various individuals OPR college reports, and an attempt to determine 
whether particular program elements correlate with these recurring 
patterns. Finally, the report will Investigate "outliers"--programs that 
received unusually strong ^positive or negative comments--in an attempt 
to identify key, features that contributed to these Striking impressions^ 

The annual OPR ^ite vrsits*will occur between Qctober anc^ May. 
The summat*y OPR Report should be available In September. . 

The^ Program Oriented Report s The Program Oriented (PO) Report 
wilt draw on data^om\Form A-1, .^rm 10, and the College Character- 
istics Report to compare actual expenditures and the collective student 

' ' • ■ I2ii ' ' ^ ■ 
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profifes at each school. The report^will not only illuminate how well 
individual EOPS programs meet student needs (questions 3 and 4), but 
also permit intercampus comparisons of program service levels. 

The report depends on cbding the A-1 'expenditure records from 
each school for computer analysis or artefyzing the data by hand. 
Several variables from each school y^ill be reported, including total 
expenditure per category, expenditure- by object class code (aggregatec^j^ 
to the 1000 level) per category, financial aid to students, and district 
contributions to coordinated services.' In addition, a systemwide aggre- 
gafion of these variables will be made. Charts and tables will facilitate 
comparison of college expenditure patterns. 

The College Characteristics Report • should be ready in February 
but the Form A-1 data will not be available until the end of summer. 
Thus, we suggest that the PO Report be cpmpleted by October. 

The Longitudinal Report. The Longitudinal Report will summarize 
the activities -- jobs, promotions, transfers -- of EOPS students as 
they depart from the program (cjuestion 6). It will also provide ojseful 
information about students' changing perspective on their school experi- 
ence and their academic and career goals (questipn 5).. 

The data from the Supplemental Survey will serve as a baseline for 
comparing students' plans and goals whep they enter the program, to 
their end-of-the-year (and following year) objectives. The comparison 
j^ill tell us something about the patterns of personal expectations and 
progress toward goals. 

The most important Longitudinal Study result will be^Jnformation 
about students' success after they leave EOPS. Graphs could display 
various categories of endeavor and the refationship between stated goals 
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and *p6st-college activities. Eventually, after the first cohort group 
finishes, it will be possible to investigate the relationship between 
background' variables, program variables, academic achievement 
variables, and success outside the program. 

The 'Longitudinal Study we*^ propqse m\\ operate in a four or five year 
cycle, and this cycle should be repeated with a new group, of students 
every four or five years. ^ While it -may take three or four years to see 
the first group through to post-EOPS program results. Longitudinal 
Reports will be issued every year, analyzing student perceptions aboujt 
goals and participation in the program. The Longitudinal Report will be 
issued in thre fall. . * , * ^ 

The Student Oriented Report . The Student Oriented (SO) Report 
win be based on data from USRS and the CPEC data base. It will 
analyze background characteristics (question 1) and academic success 
(question 5). The SO Rfeport will be one. of the most detailed of the 
six documents. We assume' here' that our proposed additions and 
revisions to USRS will be adopted^ thus allowing for EOPS/non^EOPS 
student comparisons. 

The SO Report' will first compute systemwide descriptive statistics^ 
on .all background variables fo'r^h§ EOPS and non-EOPS populations. 
Most of this analysis will require simple percentages, frequency counts 
and univariate statistic;?. Graphs or tables will display the distribution 
of EOPS and non-EOPS students by age„ sex^ financiaf need, high 
school .G,. P.A., etc.^ Individual college aggregations may be compared 
to the systemwide {Patterns. . * . 



• ^ • ' 

• The Report will also anafyze data related to student success at the 
community * college using descriptive statistics. Here too, graj^hs or 
tables will display the distribution of EOP's and non-EOPS students by 
units attempted, units completed, course enrollment levels, etc. 

Both USRS and CPEC submit their annual reports in the faH follow-" 
ing the academic year • (Chapter VI). Thus,' assuming that they report 
on schedule and that CPEC includes an EOPS identifier, the SO* Report 
wllJ l^e ready in March following the academic year under review. 

The Program-Student Interaction Report . The Program-Student 
Interaction (PS I) Report, the final document in the proposed evaluation 
report system, combines the analyses of the Program Oriented Report 
and^the Student Oriented Report, the PSI, then, subsume? Form A-1, 
Form 10, the Suppfemental Survey, USRS and the CPEC cJata base. 
The cdmbWiation of aN these data sources will make possible general 
analyses about how programs differ in response to students' needs and 
about how program characteristics affect student outcomes. Cross 

tabulations, correlations and othrer^ bivariate descriptive statistics are 

' r 

PSTs dominant analytic tools. ' * ^ . . 

.One set of analyse's in the interaction report will determine the 
relationships between student entry characteristics and the types of 
EOPS services provided. For example, >the program-student interaction 
report may provide d^ta to answer the question: "Do EOPS programs 
differ between schools Vhose^ student populations have significantly 
different goal profiles?" ^ • 

The second set of analyses will seek to determine if there are any 
links between program characteristics ^nd student .academic variables, 
such as coufse enrollment levels, units completed, CPA, awarding of 
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certificates or degrees, etc. In some instances it^may be possible to 

use multiple regression analyses to determine which program service 

variables contribute most to the 'variation in student outcomes'. For 

« 

example, the relationships between counseling hours, tutoring hour? 
and number of units completed could be Analyzed to determine the 
relative importance 'of these services to cour^ success. 

As soon as the $tudent Oriented Report is completed, probably in 
March, evaluators can turn to tHe PSI Report. It could then be 
completed by April or May. . 

Postnote 

This completes the recommenjdatidns for the EOPS / evaluation 
system. We have tried to develop an evaluation mechanism that is 
responsive to the concerns of both the^egislative and colleges study 
groups while working primarily within the existing data framework. We 
believe the proposals offererf^here, if implemented effectively, 'will 
provide the Chancellor's Office and the community coNege isystem with a 
powerful tool for program description, analysis and improvement. 
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ACTIVITY TYPES 
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t— Act. HO - Project Administrative Functions 
I— Act. 120 - Project Support Functions * ' * ^ 

I — Act. 130 - Management' Inforraatiori and Evaliiation Functions 

•Act. 140 - Other Man|gemfent^Functions 
[ — Act. 210 - Recruitment Serv](5pes Functions 

•Act. 220 - Early Outreach Fiqictions • 
i-~Act. 230 - Pre-entry Services Functions 
qN-— Act. 240 - Consortial Outreach Fimctions 

9) Act. 250 - Other OutreEch Functions 

•Act. 310 - Curriculum and Course ^Development Functions 
Act. 320 - Instructional Services F\mctions 

12) Act. 330 - Tutoring Services Functions ^ , 

Act. 340 --Other Instinictional Functions' ' c 

— Act. "^410 Educational. and Academic Counseling Functions 
> — Act. 420 T- Career and Vocational- Q^mseling' Functions 
' — Act. 430 - Personal Counseling Functions . - 

i — Act. 440 - Testing, Diagnostic, and Interpretive Fufictions 

hQ\ Act. 450 - Information and Advisement Functions. * 

n9)— Act. 460 - Other Counseling Fiinctions. 
[201 — Act. 510 - Transfer. Transition .Functions 

(21) Act. 520 - Employment Transition Functions 

I Act. 530 - Consortial Transition Functions 

•Act. 540 - Other Transition Functions 
I— Act. 610 - Interagency. Functipns 

I Act. 620 - Consulting Service Functions 

•Act. 630 - Other Special Functions 
' Act. 710 - EQPS Eligibility Determination Functions- ^' 

28) Act. 720 - Other Financial Aid Coordination Functions 

29) Act. 810 1*0 ject Staff Development and Training Functions 

f — Act. 820 « College Staff Development and Training Functions 
I — Act. 830- - Other Staff Development and Training Functions 
1 — Act. 910- - EOPS Student Grants Function ^ . 
— Act. 920 -'EOPS Student Work-JStudy Functiato 

[34 \ — Act. 930 - ECPS Stxident Loans Function 
5) — Act. 940 - EOPS Student CWS Matching Function. ^ ^ 

Act. 950 - ECPS Student NDSL Matching Functior 

—Act. 96b - Other Direct Aid s V 



C?2 

{24 
25 

(26 
27 



JO 
31 
?2 
(33 



(36 
(37 



A. 131 



4 



APPENDIX B 



REFLECTIONS ON EVALUATION OF EOPS 



By'' 



,5 James W,. Trent 
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INTRODOCTION 

It is an interesting soul-searching experience to reflect 
upon one's evaluation of a 'ma jor statewide educational program. 
It is also rewarding to 'have the opportunity to ferret out the 
different implications €or the ongoing evaluation of programs 
such as /the one to be discussed that are generated by this 
refleotion. The f ollowing^paper is an accounting of these 
(^preceiWed implications. * — ^ ^ 

In\1975 the State of California commissioned a study, 
under 'the\tfriter's direction, designed ^to provide a comprehen- 
sive evaluatieiTof BOPS in its statewide system of community 
colleges. The study was desighed to result in conclusions 
cpnceming the extent to which thfe community colleges were 
' meeting the. three interrelated sets of objectives established 
for EOPS:' Those in the enabling legislatibn (Senate Bill 164); 
in the Statement of Policy and Giiidelines adapted by the 
California Community College Board Governors; and in the 
•individual community colleges' applications for EOPS funding, / 

The study, <jompleted in the spring of 1976, was; indeed, 
comprehensive*! It included the follow4.ngji 

(1) Extehsive survey, in each of the 93 participating^ 
colleges, of representative samples of EOPS 
students, non-EOPS .students, faculty, administrators, ^ ' 
EOPS directors and chairpersons of local EOPS commu- ^ 
nity advisory committees* The surveys emphasized 
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the re'^ondents^ self-r6ported personal and 
academic charactS^stics, attitudes., perceptions/ 
experiences and anticipated outcomes. The survey 
instruments were extensively pre-tested and refined, 
and considerable attention was* given to assure that 
their items and measures reflected EOPS objectives ^ 
and related, issues. A considerable majority of all 
targeted groups responded, ranging from 70 percent 
of the E0PS students to 94'^\percent of the EOI^ 
directors. 

(2) \Analyses of institutional and' program characteristics 
btained from two document sources: (a) a "Basic^ 
Data Sheet" "designed by the Project staff and (b)\ 
pifogram ^elf-reports routinely* submitted to tjie 

stjatewide Chancellor's Office. 

' 'I' . . ' ^( ' 

) Casjil studies based on site' visits to twelve colleges'' 

ft f - 




lo 



/sp 



sated throughout the state,, and represe^al^^ng the 
ectrum of /Calif orjnia community colleges in terms 
qiisuch facfert!^ as size, student characteristics and 



district characteristics.. The case studies comprisepl 



thei pooled report^ -from th^ teams that conducted the 
site visits. With' few exceptions, ^each team consisted 
ofi a^^college president, dean.bf student personnel 

V * ' 

services, facu^y member and/or counselor and*a 
current or former EOPS student, in adciitiori to the =^ 
Project staff. In all cases reports were developed 
from interviews with the colleges' presidents and a , 
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cross-section of other key administrators, faculty, • j 

counselors, current and former EOPS students, 

ft ^ , 
representatives of local advisory conunittees and 

district superintendents. The interviews covered ^ ' 

the, complete range of objectives, processes and 

issues pertaining to EOPS. \ ' - 

This data pool' provided considerable, wide-- 

'* -^weeping knowledge cm the background, personal and ' . 

* 'experiential characteri^ics of the constituent 

groups as well as important institutional and pro- ^ . 

gram- characteristics. ItTalso made possible a / 

feature famnd very impoiltant to a program of this. 

kind : an examination of the interaction of the 

target ^groups with significatit other groups and 

their environment; 

'Much was learned from this evaluative study that has ' * - ^ ' 

implications for the increasing effectiveness of ongoing 

sy3temwide (and institutional) evaluations of EOPS. Th^se 

implications bear on three areas: (1) procedures * for the 

evaluations; (2) appropriate criteria through which, to assess ' 

the effectiveness of the evaluated programs; arid (3) various 

'issues which the evaluations miglit well take into account. 

f 

AS- indicated the outset, the intent of this^'^er ^s to ' 

discuss major implications of the former statewide evaluation 
of EOPS within each of these areas. 



imc B 135 



I 



PROCEDORES * 



^. The evaluation actually led to judgments about three aspects 

of the evaluation process, those' having to do, with the Project's 
own procedures, those having to do with the evaluation of EOPS 
per se^nd. then those having to' do with how the statewide office 
handles the evaluation process I " . 

PROJECT PROCEDURES ! . ' . ' 

Several important strategies were executed which helped 
to assure that the data base described above was a rich one* 
Each college presi4ent was dteked.to (and did) appoint his own 
college's liaison officer to ^ssi3t the Project staff to 
implement the evluation study on each* campus. In addition to 
considerable correspondence, the liaison (iffipws were acquainted 
, witsih the nature of this study and their tasks through a series 
of regional workshops held, by the Project's staff, The 

♦ 

Project's directors presented the intent and pro'cedures of 
the evaluation personally to the EOPS directors -and- studltit 
personnel deans at their statewide meetings, and they met 
regularly with' the statewide EOPS Advisory GommitteS, The site 
te^f% members were selected from nominations the* Pijoject staff 
solicited from involved individuals throughout -the- state - 
a tedious process, but one whiclj helped to assure an important 
• • sense of participation and good will among the participants, in 
th^ evaluation. Finally, pre-site^ visits were made *an<J pre- 
site team orientations were coi)ducted 4:pasl2Wire that all aspects 
of the .case studies would be taken care, o'f; and as smpothly 
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as possible. 

Three strategies unquestibnabiy contributed to remargcable 

results. The survey response rates were unprecedented, ranging 

from 70 percent of the" EOPS students to 94 percent of the EOPS 

directors. Almost all of the datasheets and' other documents ' 

requested were received. The site visits ^ent- even better tlian 
r \ . . 

planne(f. Cooperation and responsiveness prevailed throughout; 

Two research strategies, however, were imposed upon , the' 
Prpject which were debilitating. First ^ both the time allowed ^ 
(nine months from start-up to final report) and funding were 
unrealistic for such a massive project. Second, the state's 
presctiptionS for the evaluation precluded a l6ngit\idinal 
study (examining the same individuals from theVl: entrance to 
a £5rogram thxbugh ^ir termination aM/or beyoitd) , the only 
way real programmatic impact can be determined. 

THE EVALUATION . "' - • 

. ^ Primary among the po;Lnts addressed "to the increased 
effectiveness of the evaluation of EOPS were: the 
clarification of def initior^s; (2) revisions of state office 
guidelines; =(3) Validi^by of measurements; and \\) discrepancy 
among group perceptions. . , * * 

The clarification of definitions Throughout the ^ 
evaluation constant questions were raised about key e].ements 
of EOPS as articulated by the state office. A majority of 
the questions had to do with the need for £!larif ication • «. ; 

8t ^ - ^ ^ 
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leading to more consist^t classifications of dependent, 

independent and family-emancipated stxidents. 

But the problem exceeded ^this issue. The enabling 

legislation (SB 164) stipulated* that EOPS be for "•••students 

affected by language, social and economic handicaps •" The 

consensus of the site teams was that this stipulation ioidicated 

that EOPS was to be a prpgtam for the "multiple disadvantaged^ " 

In addition, the legislation indicated that participating 

colleges should develop means for identifying such students 

as well as the means for subsequently recruiting them^ 

Thus, as indicated in the evaluation report, indentifi- 
ft 

cation is taken as a way of developing and ranking the. criteria 
for eligibility, presumably based oh a systematic assessment 
of the needs of potential EOPS students in each college's 
'district. Recruitment, in turn, is the a'ctual means whereby 
students so identified. are informed about and enrolled in the 
colleges* 

The fincjings were, however, that, with few> exceptions , 
the colleges did not have a defined, articulated identification 
process, other than financial need. Nor did the state office 
compensate for this omission by providing identification 
criteria to the colleges. Therefore, recruitment went on 
without any real, systematic or consistent reference 
criteria clearly identifying* the* mvtltiple disadvantaged. 
Obviousl^, thq full assessment of ' a program's effectiveness 
is impossible whei) ttj/a^ cfiaracterlgtiqs of the constituents 



are. either undefined or inconsistently defined. ; . 

Another observation resvjlting from the study concerns 
actually identifying eopS students, however defined. A 
number of colleges refrained from labeling any program or 
student as part of EOPS out of the intent to prevent any 
negative stereotyping that might be associated with these 

programs. While fehiSc. intent might well be justified in ' some 

^ — ' * 

istances, It eliminates expedient and valiii^imethods for 

tracking 'eopS students and programs for purposes of any kind 

of meaningful evaluation of them. 

(2) Revisions of state office" guidelines . A series of 

multivariate analyses of the survey data made it very plear 

that there were a number of indicators of success achieved by 

EOPS students • These included academic achievement, presistence, 

use of EOPS services, self-perception of skills and' personal 

traits, academic motivation and educational aspiration. To 

the researchers' surprise, these indicators were statistically 

quite independent of one another, which, led to the conclusion 

that 'any systematic evaluation of a program like EOPS ought 

to allow for, even look for a varWty of critjsria, all' of 

which while relevant to the effectiveness of the program, may 

not be that much related to one another. 

Another matter along these lines came from the personnel 

interviewed during the site ^visPts . A strong consensus — 

verified by the site teams — was that ajjiy systematic evalua- 

^tion must take into account local and* changing needs and 
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situations. Guidelines for individual program effectiveness f\ 
and evaluative criteria should be flexible. The final judgment 
of the- present writer was that there was a great deal of 
quality in how .the EOPS objectives were being met and that 
'this quality in diversity should be recognized, , In other' 
words, any overall evaluation of EOPS should consider 
different institutions' diverse ^ways of meeting general 
objectives in their own right. Yet', at t±ie point of the 
evaluation, state guidelines did ^not provide sufficiently 
for either multiplicity or flexibility of procedures and 
criteria. (Those interviewed considered this true even though 
there was exhibited general /^a3^sf action with the guidelines.) 
The consensus was that t^e/^(n^delln needed to be revised to 

better accommodate « tkege, points seen by so many as crucial. 

( 

(3) Validity of measurements . The previous evaluation 

included a variety of measures . of * students; self-conc€ipt 

regarding their perceived aptitudes, skills, interests, 

« 

self-esteem arid ability to m,aster* their environment — 
dimensions important to objectives of EOPS*^ Some of these 
measures were based on previous iyjs^t^ndardi zed and validated ^ 
^scales and others were devised for the purposes of this study. 

Of moment here is the fact that most of thesfe measures 
did not discriminate adequately ^mpng the various student 
groups, whether' incoming students compared to coAtiriuing 
students, EOP^ compared to non-EOPS students, "successful" 
students compared* ' to less succes'^ful, or whatever. 

110 ^ - 
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The problem is that most of the students rated themselves 

unduly h'i^h on most of the measures, a phenomenon the writer 

also discovered a few years earlier in a .cross-country study 

of c/ommunity and junior colleges.* Apparently, the type of 

items used in these measures (and commonly used in much if not 

most research of higher education student characteristics) are 

quite subject to positive response bias or social desire- 

abij.ity. The importance of the dimensions intentionally 

being measured is not in question, ^ only the accuracy of the 

measurements. Perhaps the solution is to move toward more 

subtle or less obvious, behavi orally-based items'. In any 

eyent,^ what is essential .is to find a wa^ ^of r eliably and 

validly ^assessing the kind of student characteristics under 

w 

discussion. 

(4) Discrepancy among group perceptions , A final yt 
finding of the evaluation''^off ered nothing new to those = 
involyed'in the evaluation of ' the educational process, *but 
rather served as an important reminder: that great care 
must be taken in interpreting different groups' varying 
responses to common iteri^. For example, when asked to rate 
the level of ef fort ^th^at had been made to recruit a 

faculty, administration and staff whose racial and ethnic . 
composition reflects that of the community your colleges 
serves," 93 percent of the administrators compare.d to ^ 
46 percent of the faculty and only 25 percent of the EOPS 

* Trent, J.W. and Associates. The Study g'f Junior Colleges , 
Vol. II. Los Angeles: Center for the Study of Evaluation, 
University of California, Los Angeled, 1972. 
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djLrectors indicated that a "major effort" had been made. 

As another example, when asked if separate personal 
counseling was available for EOPS students, 31 percent of 
the administrators said yes, compared to 23 percent* of the 
faculty and only 20 percent of the EOPS students, ' but 50 
percent of the EOPS directors* Now, where does "truth" 
exist among these r'esponses? Probably in all directions, 
as perceived by the different groups* Perception, of 
course, possesses its bwn reality. But the function' pf 
evaluation is manifold: it distinguishes what is. perceived 
from what actually occurs; it assesses the effectiveness of * 
w^at occurs; and it* determines the reasons for any reper- 
ciissions of discrepant perceptions,' 

STATEWIDE ACTION ' . 

A number of responses from both the surveys and site 
visit interviews referred to th^ statewide practices regarding 
the implementation arid evaluation of EOPS*. These remarks 
especially centered upon "the state office's consulting 
function an^ reporting procedures*. " ^ \ 

(1) Consulting . . Strong sentiment was expressed both 
thVough the surveys and interviews that the specialists in 
•the Chancellor's Office ought to be more involved with the 
campuses' programs.- Only' 33 percent of the administrators 
and 50 percent of the EOPS directors s.urveyed could even 
agree that the specialists' campus visits were enough to 
maintain an effective link between the state office and the 
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individual EOPS. 

^ The administrators and directors were much more divided 

^ orr two other issues regarding the state office visits: only 
37 percent of the administrators considered the visits 
helpful, compared to 64 percent of the directors; -4 2 percent 
of 'the administrators^felt that the specialists were fair in 

^ their assessments , compared to 76 percent of* the directors. - 
Her,e> obviously, .are two additional striking examples of 
'discrepancy of perceptions between constituent groups which 
deserve additional attention in the present context. 

These data, however, are not to be taken to mean that 
the administrators wanted to see a reduction in the roleg of ' 
the specialists.* The interviews, in particular, led to the 

' firm conclusion that there should be more specialists; that 
they should have a greater? consultative role and not simply 
serve as monitors; that they should provide prompt, cons'truc- 
tive evaluative reactions to, program proposals; and that they 
shoiild provide equally pri)mpt 'information about budget 
approvals . * , , 

More specifically, the request was that there be more 
specialists to serve as resources helping the campu:^ EOPS 
personnel by providing the following': a source for "^sharing 
ideas, problems and successes across the state; orientation 
for new directors; frequent on-site react^pns and suggestions 
contributing tp program effectiveness; and assistance in 
gaining skills in the following areas: program and budget 
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planning; management; data, collection and analysis; curricu- 
lum and instructional development; and recruitment and 
identification techniques. * * / 

(2) Reporting . There was also consensus about the 
reporting procedures af the Char/cellcn: *s Office. A sub- 
stantial majority of involved individuals surveyed rejected ^. 
the endorsement that the annual <aata req^jier^ by the state 

~ 



office for the evaluaticJn of^EOPS was n 



f 



acessary to judge 

even greater majority 



the effectiveness of these programs 

(72 percent of the administrators^ and 66 percent of the 
directors) rejected ^the statement that the data reporting 
procedures are efficient. 

Still only a x:onsiderat>le minority saw no use for the 
data at all. Their main conaern was not that there be no 
evaluative data, but that the^e" revamping of reporting 

practices. S^ommonly expressed was the perception that the 
current level of data required from indij^idual EOPS far. 
exceeded that of other programs; that these excessive ' 
requirements waste time and funds; that reporting, practices 
on the whole be carefully reviewed, planned and coordinated 
at the state level-; that such coordination 'include- the. ^ 
"written" evaluation material on 'EOPS performance w4th that 
of the speciarists ' on-site visits; --and, perhaps most ' • 
cbmmonly expressed, .that feedback be prbmpt enoUgh to' be ^f. 
some use to the colleges. " 



CRITERIA 



As indicated previous ly,' the criteria fundamental to the 
^assessment of the statewide EOPS were theirtselves questioned. 
Mostly the questions had to do with clarification of "success" 
indicators- and their operational definitions. S-ince criteria 
constitute an essentia djompone^nt of, evkluktive research or 
procedures, several difficulties qpnceriVS^g the criteria ' 
indicating the success of EOPS were treated\in the above 
discussion .on "Procedures. Hence^ it-should Suffice at this 
point to enumerate these points and consider a few additional 
criteria not treated above." 

1. There were inputs from ^11 respondents that there 
was need for better definitions of qill criteria- 

and other key elements of . the mandated programs. ^ 

2. There was most evident --'as indicat^ in ^ the abov^^ 
discussion of quality An diversity that EOPS^ 

, objectives can be met inMifferent ways, ajid that/ 
therefore, there should be diverse evaluative 
criteria to refleA^ these different "ways. 
^ 3. ~ Also evident frc^J^e c^ta was the f^act that there 
should be multiple*ei?lteria for "success." Again, 
as discussed above, multivariate 'analyse^ , imperfect 
.in themselves, still revealed a, definite diversity 
of quite independent indicators of success. As' just 
one exan^ple, the evidence is that* "success" shouljd 
be considered more in tenns of persistence than 
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qi^estiohably, aqhreved grade point averages/ 

' - * - » ' ' ' y I [ 

, ' 4, Enough h-as al ready ^T^een said afebut the *need for 

established, workable ^nd mul^ple activities for- 

the identification of ootential EOPS 'students and 

* their recruitmeritV^ - ^. , ' ■ 

♦ * . ' ' * 

5. Therfe 'is also the^^tiber of ^ recruitment versus 

support criteria. The success of .EQPs' cannot be 

*. based ^bst on the Extent to which these prog:i^ms' 

recruit "disadvantaged" students and offer them 

financial a^sist^nceT^*The succegs of these programs 

- ^ . 'romust aisq b^ based, upon ^he extent tp which they do 

^bff^r^suppor^ive services that help thfe financially 

.^^ and othea^ise ^^disadv^^aged /students to advanc^ 

4;h^|:^g;h community colle^^and beyon'd'. 

'6 • . Finally , the surveys and interviews brought 't^ the 




/^^fore'^pe other major conceifnt those questioned 
geiie.^l^iy^ felt that statefwide-NQ^ideliiies for 



eValUation.^:w^i:fe ireag^na&t'y flexible, but they were 
mosi: ^a]|\a1h^^l5Qut ^jtha rcp^ fc^r this 



flexibility so 



smother local ifeeds 



.0 V «: 




statewide imperative'^would not 



The study pointed, out 
Tiportant tQ the valuation bt 




resAlved issues 
e of them havd 
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V 



^already been indicated becatise they bear .so heavily on the 
evaluation process and criteria for evaluation. So do the 
others. Thus they will be reiterated and summarized in ^ - 
that fashion.' 

THE EVALUATION PROCESS 

^ Again, evaluation is a- situation of the kind under 
discussion cannot be h one-way process. At 'issue is not 
only the state '-s evaluation of the effectiveness of EOPS 
operatin^yn individual institutions, but also the effective- 
ness of ttie- statewide office responsible for EOPS, 

Statewide Office .Procedures . Probably the most 
prominent issue ^risihg from the study had^to^^do~~wi th Tdata ~ 
pquirements. Campi>s 'of ficials found them to be far too 
frequent, too burdensome, too uncoordinated, and reported back 
to9 poorly with too little meaning. 

^ A se^od issue emphasized the statewide guideline's for 
EOPS. Although the involved respondents genera-lly we^ 
positive about them and con^dered them sufficiently flexible, 
, th^ir great concern was that they remain flexible. enough to 
^ take into account local needs and situations , They were als« • 
concerned that a statewide evaluation, such as the one thaz 
was -being conducted, would rigidify the guidelines. 

Although the respondents were generally positive toward 
the statewide specialists, certain problem's were stressed. 
These were th'e need for more quality consultative time from 
the specialists, greater and quicker responsiveness to such 



t 

matters as budget, proposals and d^ta reports and more 
orientation service. These problems, among others, coh- 
tributed to the decided conclusion that the statewide unit 
responsible for EOPS should also ,be regularly arid system- 
<^icaliy evaluated. 

Institutional Procedures ♦ The la'fik of adequate, 
operational definitions was a probl^ at the state level and 
continjied to the institutiorteil level. This lack led to a 
considerable amount of confusion ove'Jr who is really eligible 
for EOPS, In many cases f inancial^ need was the sole index 
used trt df>tg3=m4-nfci FXWn ^lLqlbl>4.^ pven thoucfh the intent' 




as interpreted through the eva\^ation was that EOpS students 
be multiply disadvantaged. Yet, as indicated, - these 
multiple disadvantages were never operationally defined, 
A related issue was whether recruitiriS^nt should be ^ 

i • ■ 

considered in any ongoing evaluation, A common criticism 
from the directors was that normal enrollment, precedence 
and wor'a-of-mouth were already attracting more EOPS -eligible 
studqnts than could be accommodated under existing funding', 

^ « Itiappropriate funding also figured into the lack of / 

* / . • ' 

long-range institutional masterplans for EOPS which wer^ to 

/ . * 

be^ submitted to the Chancellor ' s* Of f ice, Onl^F^ few campus 

/ ^ 

masterplans for EOPS existed, and most of those were^ sparce 

/' 

and incomplete.. The contention of those involved Was that 

/ 

this situation was th6 -case and would remain the, case until 
they achieved long-range funding. They argued that they could 
not make plans for the future without knowing ahead of time 
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the level of funding to be anticipated making those plans * 
ppssible to implehient. ' * 

• •i'unding came up in another important way.. Even before - 
Proposition 13 Vas an issue there was a widespread concern 
that EOPS was insufficiently funded to carry out its many-> 
mandated objectives. The question was rai-sed then ~ and • 

* * . ' 

seems even more relevant now ~ as to whether each campus 
should be required to at least attempt to seek supplemental 
funds from private sources. Should such dn activity be man- 
date^, it, too, would be an important element to evaluate. 
This situation would be even more true, if the evaluation led 
to the identification of effective, replicable techniques for 
fund raising an4^ the identification of the bet'tei: sourpes for 
funding. 

A fir^l issue concerning instituti^onal evaluation 
centered on ^he- roles of the EOPS directors. Generally, they 
\were rated quite positively (^'excellent" or "good") by other 
administrators and the faculty on all of a variety of criteria, 
They received comparatively low ratings, however, on their 
working relations with the faculty interacting witli Ihe 
community, recruiting EOPS students, planning and , " 
evaluating EOPS and publiciz*ing EOPS. Considering the 
presumed importance of some of these criteria, ^he meaning 
of the relatively low ratings deserves"^urther inquiry. 
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--^E CRITERIA ' " . * •. 

Enough has be§n said Above about the issue coricerninq 

1 . ^ . ■ • 

^quality in diversity, but its importance dictates its reitera- - , 

tion here. A majo^ finding was that there ar-e different ways 

to the same ena and that the diverse ways may well be determined 

by varying situations. Consequently, .evaluation criteria' 

should be sensitive to this ^diversity . How this process can 

best be accomplished while maintaining statewide program 

ij:itegrity may in itself const^^ute an important evaluation. 

Thes^e criteria should also be sensitive to the overall ( 

environment y^hich influences and/or is influenced by EOP^. ' 

HOPS is an interactive phenomenon. The quality, of tHat 

interaction is critical) and equally'' critical to assess. 

Two cas^ may be illustrative. Much of the effectiveness of 

EOFS" is dependent upon a supportive faculty vijLling and 

able to assist EOPS^ studepts with the. different ^'disadvantages" 

that they^com^ with* by de*st^gn. Yet, .both the surveys and \ , " 

site visits made it evident that the faculty in general were 

largely ignorant of* the n^ature of EOPS and very resistant^to^ 

faculty developmeVtr^rograms thgit would be most likely to^ 

help^ them work with EOPS students. Hence*, faculty behavior, 

' itself, may be one of the most important criteria of all to 

to consider. ^ " « - 
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Then, since much of EOPS does or should constitiite an 
otitreach program the quality of the programs' community 
relations both relations with the campus community and 
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with its * surrounding "service" conununity ~ form two o.ther 
impprtant criteria. Here, too, ^re criteria* deserving 
special consideration, since community relation^ was an is'sue 
^ found* to be somewhat problematic for EOPS in ways*^>iiscussed 
previously. < ' ^ . • ^ 

Under the cfircumstances , a major conclusion of the 
previous Evaluation appears* ^s relevant now as it did a few 
years ago; namely, that the knowledge gained through the 
evaluation resulted in: , 

1) A heightened appreciation of the diversity of 
settings in which California community colleges 
.carry^but their missions; • . 

'2) a* correspondingly heightened awareness- that 
evaluations or assessments of stat^-mandated 
programs — educational or otherwise — need 
/^always to include a syste.matic asses.sment gf 
the larger organizational and community contexts 
in whiah the programs operate; and 

'3) confirmation of the- need for legislation that 
• initiates programs like EOPS itself be continu- 
ously reviewed, evaluated. and revised in light 
of changing economic and social conditions -which 
affect the appropriaten^ss and/or precision of 
its language (p\ 1) . 

EOPS reaches iSany important levels. This program's / 

importance is such that it be adequately evaluated at each 

of these levels. Conse^ently, continued effort should be 

made 'to assume the adequacy of suqh evaluation. 
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Appendix C ' 

Revisions and Additions to USRS Data Elements 

We propose -to revise four of^the existing USRS-EOPS ' 
Student data element^, add one new element to the existing ' 
USRS-annual subsystem, and add ^at least nine elements to a, 
new USRS-annual segment which would.be collected on all ^ 
students, not just special program participants. -.Thes^ 
modifications will be described briefly in the following 
paragraphs, dnd proposed data element dictionary langiiage for ' 
each will be *presented. . 

■ . ' . »^ ' . 

Description of -Modifications "^The measurement of units 

completed (Itein E20) should take the sam^' form as . the 
-iffeas'ureiiient of units" attempted, which is currently part of 
the USRS-annual student data elements. .As Iresently constituted 
the same distinctions/are not made in the two elements.' 
Consequently/ we- are suggesting revisions in- i^^ E20 to' ' 
make, these two' elements parallel. 

As currently written the requests' for the numbep: o'f 
counseling hours (item- E6) and the 'number of tutorial hours • 
(item El 9) provided to^-each EOPS student are ambiguous. ' - 
Each college has' the option'-x^f including or excluding non-EOPS 
funded counseling and tutpring Jiours in its totals and is - 
not required to -feport which option 'it has 'selected . -As a- . 
result the data obtained from different colleg^s/are- not " . • 
comparable. We suggest that the distinctions betwee.n EOPS- 
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funded' and non--EOPS funde^i hours be made explicit in both 
da*ta items • 

There are currently seven options offered to indicate 
th^ ^€udents academic standing at the end of the term (item E2) 

5 These include thre.^ distinctions between ^^dents who are ^ still 
enrolled and three distinctions between students who 
withdrew or were dismissed. We proposed to* add two additional 
distinctions tb th9se applicable^to ?tudents no longer 
enrolled in order to describe their status in greater detail. 
These additional' categories would designate students who 
had left the college in a normal manner after completing 
a certificate or .degree program. ' * ^ 

* Currently there is no measure of academic acheivement 
prior to enrolling in a post-seconciary institution. To 

* provi(^ some common baseline acheivement data we propose to 
add*»an item reflecting high- school GPA to the USRS-annual 
data elements. _ ^ * ^ 

Finally, we are proposing that an annilal survey o£ all 
students be added to the current USRS system. At least nine 
items should be included in this survey to pjcovide Important 
fcomparison^ between EOPS students and the general college 
population. The nine items we suggest for inclusion in 
this survey are^ j^d^gh school GPA, units completed, weekly- 
student contact' hours, positive attendance ^enrollment, 
academic standing-beginfting, academic stafTding-end, annual 
GPA, cumulative GPA,. and student levels. 



Data element dictionary de'finitions for each of the 
modified elements will be found on the"^ following pages 
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REVISED • 

chancellor's office 
california community colleges 

DATA EiClMENT DICTIONARY 



i 



ELEMENT TITLE: 



E7 



ELEMENT 
NUMBER 



L 



Units Completed 



DEFINITION: 



Total number of units of credit generated* by credit 
in which the student was actively enrolled during the 
previous academic year. 



courses 



r 



CODES, CATEGORIES. AND COMMENTS: 



There are eight (8) siab-elements for this data element. Report 
units of credit completed for those types ^ courses- in whibh 
the student was actively enrolled during the last academic year- 

0, Full-term credit courses — day course. 

1- Full-term credit course — extended day (night) courses. 

2. Positive attendance credit course. 

3. (Not used. ) 

4. Instructional Telev4.sion courses (ITV) . 

5. Apprenticeship courses. 

6. Independent studies. 

7. Work experience. 

Zero fill those sub-elements that are not applicable for the 
student. - * 

If variable number of units of credit are awarded in a course, 
report the units of credit for which student was enrolled* 

Note: Th^se data elements are mutually exclusive; i.e., if 
units completed in ITV are reported; the same units should not 
be reported in the first two data elements, ' full term or 
positive attendance credit courses. 

Obtained from college course master file/registration office. ' 



^ COBOL PICTURE: 

99v9 occurs 8 times 
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. REVISED 

chancellor's office 
california community colleges 

" TA ELEMENT DICTIONARY 



DATA 



E19 



ELEMENT 
NUMBER 



ELEMENT TITLE: 



Tutorial Hours 



, DEFINITION: 



The total hours spent by ^ the student being tutored this term. 
Report separately EOPS ,and non-EOPS tutoring time, if good 
estimates are available. Include hours spent in the study 
center working with or under the direction of a tutor under 
the appropriate category. 



CODES, 'CATEGORIES. AND COMMENTS: 



There are two (2) occurrences of this data element ; ^ 

The total tutorial hours (rounded to the nearest hours) 
shoulji be reported separately for: 

J . . . . . , 

-1. EOPS -fuhded ttitoring . . 
2. Non-E0P5 funded tutoring . . f 

If the student has not received any tutorial assistance lind-er . 
one or both categories, zero fill the appropriate data. 



COBOL PICTURE: 

DATA LENGTH: 
. DATA CLASS: 
COBOL PICTURE: 



erJc 



Numeric 

999 occurs two times 
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REVISED 

chancellor's OFFICE * 
CALIFORNIA COMMUNITY COLLEGES 
. DATA ELEMENT DICTIONARY 



E6 



ELEMENT 
NUMBER 



ELEMENT TITLE: 



DEFINITION: 



Counseling Hours 



The total number of hours spent by the student this term 
receiving counseling. " Report separately EOPS and noii-EOPS 
' counseling hours if good e'sti?nates are available. 



COOES, CATEGORIES. AND COMMENTS: 



There are two (2). occurrences of ^is data elfement . 

- \ ' ' ' ^ ' ~ ^ ' 

The total hours (rounded to the nearest hour) of counseling 
should^ be reported for: ' • 

1* EOPS counseling . ^ ^ 

•2.* Non-EOPS counseling ^ ' ' « ^ ^ 

If the student has not received 'any counseling assistance ' 
* under one or both categories, zero fill the appropriate data. 



r 



COBOL PICTURE: 

DATA LENGTH : • 3 

DATA CLASS: ' Numeric 

COBOL PICTURE; 999 o^urs two times 
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USES: 



ATE ISSUED: 



ELEMENT 
NUMBER 



ELEMENT TITLE: 



Academic Standing at End of Year 



DEFINITION: 



The* Students ' academic standing at the ^nd of the previous 
academic year according to- the following codes. 



COfiEjS, CATEGORIES, AND COMMENTS: 



1 = good standing • . . * ^ \ * 

, 2 = special admit . ^ * . ' ' - * 

3 = probation ^ ^ ' . .'<9 ^ ' ' 

4 = vithdrew upon completion of certificate program 

.5 = withdrew A.S. or A, A, degree - , o 

,,6 withdrew 'Without certificate or degree, according to 

procedure . " - ' 

7 = withdrew without notice ' 

JB = dismissed ' ' . ^ ' • ^ • 

9' = other ' , • ' * . ' 



COBOL PICTURE: 

• DATA LENGTH: - 
DATA CLASS: 
COBOL PICTURE J 



USES: i 




Numeric 
9 



T51 
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ELEMENT TITLE: 



DEFINITION: 



ADDITION TO. USRS-ANNUAL 

^ chancellor's .office 
california communlfv colleges 

' .DATA ELEMENT DICTIONARY 



NEW 



ELEMENT 
NUMBER 



High School GPA 



High school* GPA as shown on student's transcript ai\d determined 
by Registrar'. 



CODES, CATEGORIES. AND COMMENTS: 



If high school GPA is' nbt -available , leave blank, 

Ro^nd to' nearest l/lOO. . ^ ' 

Obtain from Registrar.* ' ' 



4 



5» 




E ISSUED 



ANNUAL SURVEY OF 



CHANCELL 
CALIFORNIA COMMOnH 
DATA ELEMCNT 




TUDENTS 



OFFICE 
y COLLEGES 
DICTIONARY 



•NEW 



ELEMENT 
NUMBER 



ELEMENT TITLE: 



L 



DEFINITION: 



Units Completed 



Total number of units of credit generated by credit courses 
in which the student was actively enrolled during the previous 
academic year/ . - * • ^ 



CODES, CATEGORIES. AND COMMENTS: 



There are eight (8) sub-elements for this data element. Report 
units of credit completed for those tiypes of cour'ses in which 
the student was actively enrolled during the last academic year: 



0*^ Pull-term credit courses — day courses, 

.It * Full- term credit courses — extended day (nigJit) courses. 
Positive attendance credit course, ' * 

(Not used, ) ' ^ . ^ 

Instructional Television courses CITV) , 
Apprenticeship courses, \ 
Independent studies, 
Wprk experience. 



2, 
3. 
' 4', 
5. 
6, 
7. 



Zero fill those sub-element*s that are not applicable fe)r the 
student. 

If variable number of units of credit are awarded In a course, 
report the units of credit for which student was enrolled, 

No^e: ^ These data elements are mutually exclusive; i.e,, if units 
completed in *ITV are reported, the same units should not.be 
jreported l»n the'^first two data elements, full-term or positive 
attendance credit courses* 

Obtained from college coi^rse master file/registration office. 



COBOL PICTURE; 

99v? occurs 8. times 



tiSUED: 
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ELEMENT TITLE: 



DEFINITION: 



ELEMENT 
NUMBER 



Average number of class hours for which student is actively 
I enrolled m full-term credit, course(s) ,during.the past academic 



CODES, CATEGORIES. AND COMMENTS: 



There are>-twQ, (2) occurrences of this data element s 

(Refer to record formats * in Appendix G.) Report WSCH for day 
courses and extended day (evening) courses separately; 

This data element is \o be reported only for students actively 
enrolled in full-^term credit. course<s). If the studelvt 
is not actively enrolle* in a full-term credit course, zero ^ 
fill data field. .^ ^ 



j 



4 



\ 



COBOL PICTURE; 

. DATA- LENGTH: 3 > 

DATA CLASS: Numeric Display 

COBOL PICTURE: 99v9 
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USES: 



TE ISSUED: 



Tel 



' ^ ANNUAL SURVEY OP ALL STUDENTS 

chancellor's OFf^lCE 
V CALIFORNIA COMMUNITY COLLEGES 
DATA ELEMENT DICTI^ARY 



NEW 



1 



ELEWEliT 
NUMBER 



EELEMEN1?,TlTCEk 



I 



It DEElNmON^/- 



Positive Attendance Enrollmeht, Annual 



V 



A code to i-n4icate active enrollment in positive attendance 
course (s) at ^ny time during- the past academic year. 



ic6DEStCATE"60RIES*?AND£C0MIVIENT,S: 



CODE 
0 

1 

2 



CATEGORY 



^ Student was not enrolled in a positve attendance course. 

Student wa^-^rolled in a positive atteiiidance course. 

Student was enrolled, in a positive attendance noncredit 
course. 

student was enrolled in bpth positive attendance credit' 
and noncredit courses. 

Student was enrolled "in a non-state supported class. 

Ther^ are two (2) occurrences^ of this data element . Report ejiroil- 
ment in positive attendance, courses separately for day and extended 
day (evening) . ^ ' , ^ ... 

• ^ 

Extended day course is any course starting at or after 4:30 p.m. v 



COBOL PICTURE: 
r • DATA LENGTH: 
DATA CLASS.: 
. , COBOL PICtOrP ; 



Numeric Display 
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ANNUAL. SURVEY OF ALL STUDENTS 



chancellor's office 
california community colleges 

DATA ELEMENT DICTIONARY 



NEW 



ELEMENT 
NUMBER 



ELEMENT TITLE: 



Academic Status at Beginning of Year 



DEFINITION: 



Student academic standing at the bejgiiihing of the first term 
the student was enrolled during the past academic, year to. the 
fallowing coes. ^ , ^ 



h 



CODES, CATEGORIES. AND COMMENTS: 



1 = good standing 

2 = special admit 
^3 = probation 

9 ^ other/unknown 



Collected by EOPS Director at beginning of term. 



COBOL PICTURE: 

' / DATA LENGTH: 1 

DATA CLASS: Numeric 

COBOL PICTURE: 9 
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USES: 



ATE ISSUED: 



: 



ANNUAL SURVEY OP AI^L STUDENTS 

• C><ANCgaOR''s OFFICE « 
CALfFCRNIA CCMMUNITY.CtoEGES' 
DATA ELEMENT DICTIONARY . 



NEW 



1 



ELEMENT 
NUMBER 



ELEMENT TITLE: 



L 



Academic Standing atffendbf^vlkr 



DEFINITION: 



V 



^ The students' academic standing^ at the end of the pre\^ioi}s ^cademi 
year according ,to the following codes. ^ 




COOES, CATEGORIES. AND COMMENTS- 



4 = 

5 = 

6 = 



1 == good standing * * , ' , ^ ' 

2 - special admit . , 

3 = probation . . 
withdrew upon completion .of certificate program ' 
withdrew upon receipt of A.s: or A. A. degree 
withdrew without certif^^||^e or degree,^ but according to 
^ procedure * " ' i- 

T = withdrew without notice 

8 = dismissed - ' , . 

9 - other - * . ' 

. ■ • ■ 

1 



aing 




COBOL PICTURE: 

DATA LENGTH: 1 

DATA CLASS: Numeric 

COBOL PICTURE: 9 ' 




ANNUAL 'survey OF' ALL STUDENTS 



ELEMENT TITLE: 



DEFINITION: 



chajicellor's office 
california community colleges 

DATA ELEMErfT^ieriONARY 



NEW 



ELEMENT 
NUMBER 



Annual GPA 



GPA earned during the previous academic "^ar^^s determined by 
college Registrar. % J * 



COOES, CATEGORIES. AND COMMENTS: 



Round to nearest 1/100. * ' 

Obtain from Registrar at the end of academic year. 




COBOL PICTURE: 

DATA LENGTIf>- ' 
DATA CLASS: 
^ •• 'COBOL PICTURE: 
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USES: 



ATE ISSUED: 



Numeric 
9v99 



I 



ANNUAL SURVETV^OP ALL STUDENTS 



chancellor's, OFF J CE 
CALIFORNIA COMMUNITY COLLEGES*^ 
DATA ELEMENt DICTIONARY 



ELEMENT TITLE: 



DEFINITION: 



Cumulative GPA 



- NEW 



ELEMENT 
NUMBER 



Cumulative GPA^at the end of the previous academic year as shown 
^on student's transcript and determine^ i|)y Registrar, 



COOES, pATEGORJES, AND COMMENTS: 



If cumulative GPA is not computed, leave blank. 
Round to nearest 1/100. 

^tain from Registrar at the end 6f "academic year. 



/ 



COBOL PICTURE: 

DATA LENGTH : 3 ' 

DATA CLASS: ^ Numeric 

. COBOL BICTURE: 9v99 




ANNUAL SURVEY OP .-NEW STUDENTS 



• 4 



chancellor's office 
california community colleges 

DATA ELEMENT DICTIONARY 




ELEMENT TITLE: 



Student Level, Annual 



1 DEFINITION: ■ 


1 • 


The total accredited work comE)leted ^as of the ^first census weeK 
of the first term in v^hich the student was enrolled during the i 
r past academic yeai: which reflects the student's level of academic / 
/ achievement. / 


1 COOES, AND COMMENTS: ^ ^^^^^^HI^^^H^^BBS^H 


C&DE 


CATEGORY - 




n j.^xi ocnoo J. s uUuenc 


2 


Freshman 


■"a 


Sophomore with 30-5? semester units' or 4 5-89 -quarter 
units • ■ / * 

• 




student with 60 or more semester units or. 96 or more 
quarter units. • , 


5 ~ 


Associate Degree / ^' * 


6 • 

» 


Bachelor's Degree or. higher ^ 


. 9 

V 

< 


Unktiown ^ 


* * 

7 


• 


COBOL PrCTOREr = • • 
DATA LENGTH: 1 

DATA CLASS: - . Nximeric Display" ...» ' 

•COBOL PICTURE: 9 , • . • . . • 

>, • . . ' , 
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USES: 



TE ISSUED: 



131 



chancellor's office 
california community colleges 

DATA ELEMENT DICTIONARY 




ELEMENT TITLE: 



DEFINITION: 



High School GPA 



High school GPA as shown on student's transcript and determined- 
by Registrar. 



CODES, CATEGORIES, AND COMMENTS: 



If high school .GPA is not available, leave blank, 
Round to nearest 1/100. 

Obtain from Registrar. ^ ^ 

o 



CpBCL PICTURE: 
9v99 
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USES: 



E ISSUED: 
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APPENDIX D 



STATE OF CALIFORNIA 



EDMUND G. BROWN. JR.. Governor 



CALIFORNIA POSTSECOIMDARY EDUCATION COMMISSION 



Student Oriented' Data Bases Maintained by the Comnii 



ssion 




5 



Data Bases are available for all years between 1976 and 198Q. Data 
Elements noted with an are available since 1979. 

A. Student Enrollment Data Bases 

1. Public Segments - One record is maintained for each 
student. enrolled in the Fall term. Each record contains 
the following data elements; 

a. campus where the student is enrolled, 

b. student level (e.g., freshman, sophomore) , 

c. student status (e.g., first-time, transfer, 
continuing), 

d. student major, " ^ 

e. fee status (rfesident/non-resident) , 
citizenship, (e.g., U.S. citizen, not U.S. citizen). 



f. 

h. 
i. 
j- 

k. 



r 



full/part-time status, 
credit load (undergradua-tes only), ' ' ' 

sex, 

ethnicity (six categorie^s defined by OCR plus 
Filipino,' No Response, and "Other"), 

student program (e.g. , Biology., Mathematics,^ 
Sociology), ^ 4 

age, V . 

4 

high school of origin^^ (for students classified as 
first-time freshmen only), 

institution last attended* (for students classified 
as transfer students only), 

permanent residence- (zip code, county, or^Community 
College district) . - ' \* 
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2. Independent Colleges and Universities - A single record is 
maintained for each campus . Each record supports Che 
followiiig data elements: 

\ a. campus, 

b. student level (e.g., freshman, sophomore), 

' • c. sek, , . * 

d. ethnicity (six categories defined by OCR; does not 
^ - include Filipino, No Response, or Other 
classifications) . 

B. Degrees Conferred Data Bases 

^ 1. Universit^ of California and the California* State 

^' University and Colleges - One record is tiiaintained for 
each .student receiving a degree during an academic year*. 
Each record supports the following data elements: 

% 

a. campus where the degtee ^as awarded ,> 

b. degree level (e.g., bachelors, masters),' 

c. sex, 

d. ethnicity (srix cat^egorps defined by OCR plus 
Filip^ino, No Response, ^d "Other"), 

e. " program (e.g, , Biology, Mathematics, Sociology), 

age, , 

g;. high school of origin* (for students entfet'ing as 
"native" students o^ly) , 

. institutidto last att^de(^ (for students entering as 

txransfer students only),'^'^;* 

^ ■ 

i. ^permanent residence* (zip code, county, or Community 

* . College district). 

2. California Community Colleges and In.dependent Colleges and 
Universities - A single record is maintained for each 
campus . It^contains aggregated information arranged in 
the following manner: 
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campus where degree was awarded, 
the number of degrees conferred by: 

1. degree level (e.g», associate, bachelors), 

2. sex, 

3. ethnicity (six categories defined by OCR on 
A. program (e.g.. Biology, Mathematics). 
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APPENblX E 



WHICH. TYPE OF STUDENT ARE YOU ? 

There are many reasons for attending, a community college. We would like 
you to classify yourself in terms of the following descriptive statements. 
Choose one . ' Of course there are no right answers.. Students of all types 
attend classes here. ' . . * 

VOCATIONAL ORIENTATION 

I. /I am enrolled in a one or two year career program. 

II. I am primarily interested in obtaining skills for an entry level job, 
and I may leave school as soon as I am able to find such a position. 

in. I already have a job with career potential, and I am attending college 
part-time to increase my skills for a promotion 6r raise. ^ 

IV. I have a career ^already, and I am attending college (part-time) tb 

obtain skills for a second career or an additional after-hours job, . , 
e.g. real estate. 

V. I am tAking 'just a single course or two that are required to renew 
the license for my particular job. 

- /transfer orientation 

VI; My goal i? a BA or BS degree. I am a full-time student, and I have 
^a ^ood 6PA. All together it will probably take me between 2 and 5 
semesters to transfer. 

VII.^ Ml^goal is^ a BA or BS degree. ,1 am a part-time student, and I have 
a^good^'GPA. All together it will probably take me more than five 
i semesters to transfer. * ' 

VIII. I think I want to obtain a BA or BS degree, but my coursework isxi't - 
that strong and my 6PA may not be good enough to transfer. 

IX. I m hoping to ge-t a BA, but my .real interest in transferring issto 
play intercollegiate sports. ^ 

X. I want a BA or BS* degree, though I am proceeding through my course 
work slowly: I'll be able to tlransfer eventually if J can continue 
to get financial aid Icmg enough so I can stay in school. 

* XI. I am already attending a four year coll-ege, and, I'm currently enrolled 
here to make up selective credits of take additional courses. - ' 

XII. My goal Ms a BA or BS degree. \ am concentrating'^on vocational , / ' 
courses that are .transferable to a four* year program. ^ • ' a .^^. .5 
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OTHER ORIENTATION ' . 

XIIIi Tm not really t+iat interested in credits. Tm attending co.llege 
part-time to get better skills related to my personal interests and 
hobbies. 

XIV. Vm not really that interested in credits. Tm attending colleger 
part-time because I just like learning. Most of the courses I take 
are academic ratfjer than skills. 

XV. ,1 have little interest in credit. I am interested in cultural 

experiences and take courses in art, history, drama, music appreciation 
etc. - * _ . 

XVI. I need bas.ic skills in math, reading or writing, (e.g. someone who • 
might be seeking a GED). ^ ^ 

XVII. I am taking basic preparatory courses that I need to transfer to a 
vocational program that is not available at this college.* 



*Adapted from prototypes developed by Steven Sheldon and Russell Hunter 



V 



4 



APPENDIX F 



♦ 



COMPARISON OF EOPS APPLICATIONS AND FINAL CLAIMS*, 



♦Data for this report collected, by, Jenifer Franz. 
» Repprt written by Jennifer 'Franz -and Marvin C. Alkin. 
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Background - ' 

In the course of this study we have identj^f ied^a variety' 
of state and local information 'needs and Existing documents or ^ 
data sources which might meet those needs. A primary potential 
resource identified was the EOPS- application form or "College 

ft - 

Plan for the Extended Opportunity 'Programs and Services 
Project," commonlys referred °to as Form 10. The questions 
and information it-ems which Form 10 addressed pertained to a 
descfiption of the elements of the EpPS program, levels of 
services ]6rovided in the EOPS program, and resources expended, 
^hat was not clear, however, was the extent, to which the • 
estimates and proposed plans contained in a college's , 
application reflected actual porject operations -and levels of 
•service. We therefore determined .that it would be necessary 
tp compare proposed and actual efforts before incorporating 
Form 10 into the evaluation system. 

Approach ' , ^ 

The two forms used to determine the congruence between 
what colleges proposed to undertake arid what they actually ' 
did "were the -application and the year-end "Budget Approval 
%n^ Final Claim" (Form 7). Because final claims tor 1980-81 
had not, yet been .sflbmitte^ when the comparison needed .to be 
made, it, was necessary to use data /from 1979-80 - before 
Form 10 had. been developed. However, its predecessor 
(Form 10 .& 12) contained many of the same eleitients and was 
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deemed sufficiently similar to- provide a valid measure. 

The colleges to be included in the comparison wer^ 
selected by applying numbers derived from a random number 
table to the alphabetical listing of ^mmun^Lty colleges in 
existence, in 1979-80 " ( California Community College Dictionary: 
1979-80 ) . Of the 10% of all colleges so selected (n=ll)^ 
two did not have final claims for 1979-80 on file. Thesk * 
were replaced with two moref * randomly selected colleges, of ^ ' 
which one did not have a final claim on file. The final , \ 
sample was thus developed via a thiri^ random selection process 

Table ^1 shows the colleges included in the sample along 
with information concerning, their size and location single 

— WW' * 

. * - • . " 

'dampus/multi campus; north^r'n/southern Qalifornia) . As this 
table suggests, although the^ample colleges are prt)>Dably not 

'totally representative of all • community colleges in the sjbate, 
they do 'include colleges of all types - i.e., small, medium 
and large; sihgle^ and multi icamp^s; and from the northern and 
southern parts of California. ' ^ * ^ , 

Once the colleges in the sample had been idenl^ified, 
their applications and final claim folders^were. pulled cfnd 
selected data items on the two sets of forms were compared. 
Because the amount of information on the claim forms was 
substantially less- than the amount of the information in 
the applications > the comparisons whicli^could be mad,^ were 
limited to pro]^osed and actual expenditures' and numbers of 
students served. Accordingly, the findings which follow ^ 
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TABLE I 

Characteristics of Sample Colleges 



College 
Bakersfield Colle'ge 

Cerro Coso Commur^ty College 

CuyamaCfi College 

La ney College^ 

Lassen College 

College of Marin 



Saddleback CoT.lege 
Sa/i Jose City College 



♦ SierVa College 

Solano Community College 



Fall 197* 
Enrollment * 

12v2l''o 
3,650 
2,033 

• 10,130 

■r 

3.044 ^ 



11,315 

♦ 

21,644 
^ 13,761 
" Santa Rosa Juni0r Collfe^e ' 19,501 



8,370 
8,907 



Multi Single * 
Campus/Campus North/South 



Multi 
' ^ Mg 1 t^i ' 
Multi 
Mu>ti' 
• • Single 
Multi 
Mul ti 
Mul ti 
Single 
Single 
' Single 



South 



South 



South 
North. 
North 
North 
'^outh 
NoHh P 
t North 
North 
NoVth 



♦Largest enrollment FaH 1979 = 28,'308 ftong Beach); smalle^st enrollment 
Fall 1979 = 573 (fWWerde) 
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essentially encompass only.two of the information items ' 
included iVi Table 3. ' ^ . 

Finding^ - ^ " . , * ' ' ^ 

As noted 'above, most of the inf ormation'-^Atained ^in 
the EOPS application is not repeated in subsequent, documents . 
It/is therefore possible only to speculate about the extent 
to which program plans are congruent with actual pi^grarti W 
operations. However, the evidence with respect to planned 
vs. actual expenditures and numbers of students served 
clearly implies substantial'^ differences between what EOPS 
projects propose to do and w.hat they actually accomplish. . 
This evidence^ is diiscussed in detail below. ' ^ 

Table 2 shows the aiAounts of J}6pS f unds^ awarded to the 
sample coMeges, including their initial grants, any aug- 
mentations and all ."recycled" funds (unencumbered monies ^ 
reallocated from one^ycollege. to another before the end of 
the fiscal year), T^J^le 3 compares the "ad justed* totals" 
derived -from tljese var':jjp6s transactions both' t^ t]ie amounts 
applied^ for and to 'the amounts actually expended* * 

As these tables indicate, total expenditures for all 
but one institution (Laney College) were exceedingly close- A 
to their adjusted total •EOPS grants (including ^augmentations 
and the "recycling" of uneflficumbered funds). However, they* 
were ,onl/-occasionally similar to the amounts originally 
proposed. All) eleven colleges -spent less than they^ applied ' 



■/ ^ 
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^iA . . ■ TABLE 2 













• ... Co'l lege 


Funded 


Auampn+pd 




/\aj usTea i oTa I 


Bakersf ield»'Col lege 


234,523 


1 ,304 


-10,000 


225,827 


^C^ro Coso Coniiunity Col lege 


106,237 




— 


^6,237 


Cuyamaca CoJ lege 
Laney Col lege « 


51,921 
406,372 


306 
• 2,308 


-56,000 


.58,233 , . 
352,680 


Lassen Co'l lege 


168,91-2 


932 


-36,000 


205,8_44 


Cai lege of Mari n . 


2l^*i638'^ 


1,206 


+l«,000 


230 ,'844 


Saddleback ColHeqe • . 


< 

100,088 ' 

r 


5'44, « ■ 






San' -Jose City 'to Uege " 
. *Santa* Rosa Junior ^1 lege 


187,779 
^87,64(!) 


,U053 




188, 83? 
-287,640 ' 


* .S ierra CoJ lege * ^ < ^ 

Soiano'.Communi ty^•Col lege 
»• 


l74,-237- 
163,658 


m . 


+15,500 
^15,000 

I'- 7,500 


. 2Q4_,695 
I, 157,063 






* 






. - \ 

V . ; . 








- • •• < • , 


^ . >. 


r 


» «r • * 
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TABLE 3 . ' ,-• . - 

EOPS Funds Applied For, Granted and Expended 

Application Adjusted . Returned To 

Co 1 1 ege Amount Total Grant Expended (Treasury 



Bakersfield College 278,466 -225,827 "^225, 827 

\ 

J 

Cerro Coso Commun ity CoUege 106,237 106,237 104,176 2,061 

Cuyamaca Col lege 71,816 58,233 58,233 

Laney College ' 1,503,800 352V680 306,647 ' 46,033, 



Lassen Coi lege * 366,000 205,844 ' 205,844 

Col lege of. Marin " 353,299 2J0,844 ^30,844^ ^ — 

Saddleback Col lege >483,094 100,632 / 97,474 3,567 

San Jose City Col lege / 363,408 * 188,832 • 188,832 

Santa Rosa Junior College 287,640 287,640 275,011 12,32^ 



Sierra Col lege ' 582,866 204,695 204,695' 

Solano Community Col lege 184,956 > 157,063 156^544 519 



It is unclear why the- f ur)ds expended and returned to 'the treasury for 
Saddleback and Santa^Rosa Vlo not add to the adjustlfi -J-otal grant. > 
Howev^, the d l-f^ferences aVe small and do not sudstantlal lyalfer 
the relationship between pns^osed an^J actual expenditures. 



for, and more than half'(n=6, or 55%) ejtpended over $100,000 
less. In one instance, the differencfe wasNu^ $1 million. 

■The discrepa'ncy between proposed land actual expenditur.es 
6f district funds, displayed in Table 4\is som47hat similar ' 
to that for EOPS funds; Only two Colleges shent whai* they 
proposed to spend, while another three • w/fewi thin $10,000 
and 'a fourth was within $20,000. The remainder (45%) were 
off by over $100,000 * and all but one 'of theSe* was off 
by more than $200,-600. "However, although ^11 eleven colleges 
s.pent fewer EOPS dollars ,than they proposed to, .two spent more 
district funds than they proposed: one* by relatively 'little 

($5,88.1 - Saddleback); but one by a substantial sum * 

• ■■ ■ 9 

($693,809 - Cuyamaca)'. 

. Perhaps pxediatably^ given the differences between 

i ^ - ' ' * • ^ . • 

proposed and actual expenditures, no college served the 

numbers of 'students -it proposed to, ^as Table 5 indidan:esT. ' 

f \ . > • ' \ 

Differences ranged from relatively insignificant (e.g., Cerro 

^ r " * 

Coso — ^32 students) to the almost inaredibie (e.g^, Cuyamaca, 

which served only 9.6% of those ^t proposed to arid Laney, , 

which served 22.1%).^ Among all eleven doll^ges, service 

was proposed for 5, ,9 50 students and actually, delivered to 

3,730 - a net decrease' of • :i7% ? ' '<> 

Tables -6 throijg||^8 depict proposed and actual EOPS ' 

expenditures and student^ served by Part.^ (Student figures 

are not given for. Part A because Part a' f ujtds are not ;is^ed 

to provide- direct services C) Ftm the ^ata we note t;hat 



no 



'TABLE^4 



roptrsed and Actual Expenditures of District Funds for EOPS 

^ ; ^ : • • 

Co I I ege . - Proposed Expenditures Actual Expenditures 



Bakerstield Col lege 



486,230 • 296,522 

Cer.ro Coso Community College ■^513,604" 205,524 

Cuyamata* Cc^ I eg,e • 73 , 38 1 - 767 , 1 90 

» ♦ 

Laney College l,740>750 1,103,462 

Lassen Col lege * , '* 498>60b'' • ' 205,844 

College of -Marun ' 345^802'' \ 34J ,871 



4 



Saddleback Col l,ege. ' 3^^I6- 379,497 

San Jose City College / '587,838 - - ' , 5§7,838 

Santa Rosa Junior CbMege . 730,41,8 • 514,731 



Si^erra^ College ^ ' ^ . 290,209 ' ^ . ' 274,630 



31^ C9mrrii 




Solar^ C9mmunity Col lege # 835^022 « ^ , 835,022 



. *^Proposed expenditure data are -taken iFrom estin^ates recorded. on ^the- 
' approved budget since estimates reported in the application *<:onib^^ 
loc^l, federal ajnd other fund^. , - > - 



T^.eLE 5 



Proposed -^nd Actual Students Served (Undup I icated Count) 



\ 



Co I I ege^ 
'fiakersf ield Col lege 
Cerro Coso Community College 

4 

Cuyamaca Col lege 
Laney College 

* •* 

Lassen Obi lege 
Col lege of Marin ' 

s 

^Sad.dleback College 
^San Jose Cjty College 
Santa Rosa Junior College 
Sierra* Co I lege 
Solano Community Colfege 



Students Proposed 
To Be Served 



300 



125 
250 

I ,000 
375 

I ,800 
400 
400 
500 
400 

.400 



Actda I ^ 
Students Served « 



350 



93 



24 



221 



312 



■814 



278 



309 



545 , 



178 



606 
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4 • TABLE 6 
PART A: Proposed and' Actual Expend.! tures. 



Expenditures 



Proposed * ' Actual ^ 

Expend i tures 



.Bakersf ield Col lege 20,645* ; 31,250 

^ Cerro Coso Community College 8,448 ' 11,081 

Cuyamafca,eol lege ,21,722 27,32S ^ 

Uney^Gb liege f 73,100 . ' 5^,726 

/ Tassen '00! rege ' 83,000 ■ ' ■ 39>430 

College of Marin . ^ -0- -0- ' 

Saddleback Cot I ^ge ' x c 41,350- "44,956 

. . ^ ■ . 

♦ ' San Jose City C^Nege* ^ 37,400 " 38,006 
ft 

» "•.*.•' 

. Senta Rosa Junior College ^ Y*'5,734 - 22^896 

■ ■ ^ V ^ -^'^ ■■ ... ' . 

Sierra Col lege 26,815 31,359 

t » So I ano ^^iDnvnCjnity J^oJ.lege ^ 35)425 17,343 ^ 



4 . 



V 



V 



• . Actual* -expenditures dre presumed to be those cla/imed** 

$8, 128 .transferred fjrom Part A C$6,262) *and T^art ($1,866) +o Part C 
after f i na f claim v^as/f i 1 ed . ' ' " * 

k':^' ..Tie. ■ . , 



i • TABLE 7 • • , \ 

. PART B: J^roposed and Actual Expenditures and Styidents Served 

* ' , , ■ • Proposed • , ' Actual 

5 V Co 1 1 ege ^ Expenditures Students Ex(?enditures 

: ' — ^ 

Baker'sfield Col lege 92,821 "300+" ' 78,383 

\ ' I 

' Cerro-Coso Community College ' • '' 51,789 * •*■ |.25 ' 59,156 



Students 



350 



93 



24 



Cuyamaca Coljege ' " 35,094 250' ' 15 657* 

» » * - . » 

^Laney Co'llege ' - ' 353,700 I ,000 • ' •127,736 * 

Lassen College. . ' ' ' 183,000 375 . 52 839 

«"■'-••*• ■ . . • ■ . . ' 

Co-jlege of Matrin , ^ . ^ "*;222,049 700 ' 156, a44 

Sadcj I aback Col lege . j, 153,744 ■ ' 400 22.,853 -65 

San. Jose Ci^tf Col lege « 180^308 . - 400 43,391 ' 309 



24 , 



312 
823 



"College ' 166,406 ^ 500 . 137,620 ' , 545 

■..^ • • •. -m . 

S . ^ .98,^51 : 400 83',406v 178 

• f 

Solano Community Col lege. _84,527 4ort * p6,296 478 



$^,128 transferred -from Part A ($6,-262) and F^rt 4^.1,866) to Part C af\er final claim was filedn 



PART C: 



TABLE 8 ^ 
Proposed and Actual Expenditures and Students Served 



Co I lege 



Proposed - 
Expend i tures. Students 



Actual ^ 
Expenditures Students 



Bakersfield College 

\ 

Gerro Coso Community College 
^ Cuyamaca Col I ege 
Laney Col I fege 
Lassen Col lege 
Col lege of Marin 



Saddleback Col lege 
Saji Jose City Co I J ege 
Santa Rosa Junior College 
Sierra Col lege • ' ^ 
Solano Community^ Col l^ge • 



^" 165,000 

• * 

46,000 
15,000 



"300+"' 



125 



100,000 



131 ,250 
288, OOO 



145,700 
105,500 ' 
257,500- 
67,000 



75 



,097,000 , I,, 000 



375 



170 



400 



228 



500 



400 



100 



I 16,194 
■ ' 33,939 
15,248*^ 
1 2 i, 185 
. I 13,575 
^ 74,000 
"25,665 
' 107,435 
I 14,495 



•89^930 



82,905 



300 



24 

I 

221 ^ 
157 
241 
65 
212 
545 
178 
128 



$8,128 transierred. f romrPart /\ ($6,262) and Part B ($1,866) to Part C after final sl^aim was filed. 



college spent^ what it^ proposed to in any Part or (with" the 
.possible exception of Balrersfield College's some\;5}iat vague 
p;:.oposal) served the numbers of students it planned to. 
Generally speaking, less was spent and fewer students were 
servecj than specified on othe application, but this is not 
uniA>er sally the case in ally Part. Moreover, the magnitudes 
of the changes range from lows ;of $248 and 16 studfents 
(in different collegesTto highs of $975,815. and 976 students 
(iij the same college) . - , 

^Finally.; it shquld be noted that although in 'most colleges 
JiXie J;o1:al amounts expended/were the same as or very similar 
to amounts ^warded ^ wijtJh: the result that approved budgets -.^ 

are .quite reliable indicators of actual program costs,- this 

* J. . " 

is not quite as, often the case with ^respect to expenditures 

under the .vai^ious -farts.. Colleges have the option of traris-^ 

,f erring funds from one Part to another during the year, ,and 

ail but one of the cb^lieges in the sample d*G so in 19^9-80. 

The aino\ints» transfej^ed, which are shown in Figure 1, tenjied 

to be fairly small, but in four .instances were quite / 

substantial:. $9,^743 by Bakfersfield College; $10,000 by,. 

Cerro Cos^ College; $47, 375 by Laney College;, an^a $"2.^,000 

by Solano College. These " figures represent 4.3%,. 9.4%, 

13.4% afi 12.7%, respectively^ of the colleges' adjristed 

total EOPS budgets. ' . . * * 

Conclusions ' ; , % . 

' ^ • » * * _ ' • 

- . • «i • 

The data discussed in the^.precBding sectign strongly ; 
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FIGURE I 

Transfirs of Funds Among Parts A, B & C 



Bakerstield Col lege , * ' ■ . 

•"02,094 to Part B:" $377 from Part A & i$2,71-7 f,rm Part C ' 
■ _ $9, 743 from Part C< $7,-2^6 to> Part B '<§. $2, 477 to Part A. 

Cerro'Coso Community College *• '' \^ 

■ $382. from Part B to Part A ■ ' "^^S-rf*"^ 
$10;000 from Part C: 3,496 to Part A <§ $6,504 to Part B 

Cuyamaca Col lege * — 

$8,228 to Part C: $6jS2 from^Part A $1,866 from Part B 



Laney Col lege - • - _ _ , - 

$47^375 from Parts A & B to Part C ' ' ' ' 

Lassen Col lege . . \ • 

$4,796 from^Part B to Part C- . 

» . A ^ 

College of Marin - . _^ 

None \ ' ' 

Saddleback Col lege ^^ ^ . • 

$289 from Part B to^Part A 
- $S\ 799 from Part B to Part A 

San JOse City Col lege • • 

$300 from Part A to Part B . ^ 

^ $S;236 from Part At, $2,82? to 'Part B and $2,409 to Part C 

$2,02? from Part C: i}L,\i^9. to Part A and $868 to Part B 
Santa Rosa Junior College 

^^350 from Part B: ^ $3,350 to Part A i $4,000 to Part C 

Siferra Col lege . - ^ . 

• $3,964 Part C: $474 from Part A & $3,490 from Part B ' 

$4,464 to Tart C: $974 from Part A 4 $3,490 from Part B- ' 

$3,000 from Parfi C to Part A 

9 

Solano Community College 

$20,000 to Part C: $27,857 from Part A & $2',lr43 from Part B 
U,000 from Part B' t^ Part A , ■ ' 



s-u^gest thet EOPS applications^ bear little relationship to 
afctual program expenditures' and op^^ations. Both dollar 
amounts expended' and numbers of students' served vary sub- 
s'tantially^ from pro pb^e4 to actqal in .most colleges. In 
general, the changes are in a negative direction^- i.e., 

A • ' * 

less money spent and few stuckenta .served - but this is not 
universally the case. Moreover, the trends of the two ' 
variables are not necessarily parallel: colleges may serve 
more students with fewer dollars or fewer students with more 
dollars. • - * ^ 

Approved* bu^^ets are quite reliable indicators of actual 
•expenditures for the large majority of colleges', ii^ terms of 
total dollar amounts. .However, because c61 leges have the . . 
option of transferring funds among Parts, these budgets ''do 
not accuraitely reflect expenditures by activity.- ^'urthex:-. 
more, they tend not to show -planned decreases in the numbers 

of students to be served. • . ^ 

^ S ^ 

In sum, ^gi'nning-of -year -documents do riot appear ^tb be 

a reliable source of infornj^rion a^bout what EOPS jjrograms 

\ , ■ X ' ^ * ' c 

actually do, at least insbfar as. expenditures and numbers 

of Students^ served are concerned. Whether the other informa- 

tion items Uncluded in t^ie application ate less subject to 

change canndt be determined from final t:laims and related 

documents, but it would appear probably that as ^funds^and 

.niambers of students change, other * aspects of t^he^ program 

would of necessity changev^as well. Accordingly, it is ~ - 
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f 

highly likely that EOPS project applications are of minimal V 
utility in program evaluation* ^ , ' 



0 



0 
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FOOTNOTES 



=Final claim folders include all program claims for funds 
along with the program's approved .budget , the documentation 
of transfers -among Parts A, B & C, other amendments to- the 
approved budget and related corres^Jondence. All of these 
items were' reviewed, and some of them served- to- enhance the 
analysis of application reliability. Those w,hich proved to 
be. pertinent are discussed under Findings. 

It should be noted that although Laney College served roughl 
one-fifth of the .students it planned to serve yith somewhat 
over two-fifths (43.5%) of the state and local funds it 
applied for, Cuyamaca spent 569% of what it proposed serving 
one-tenth the numl3er of students. 
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